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^ ■ Abstract 

■ We consider shot noise processes (X(t)) t >o with deterministic re- 

Q ! sponse function h and the shots occurring at the renewal epochs = 

So < S\ < S2 ■ ■ ■ of a zero-delayed renewal process. We prove conver- 
gence of the finite-dimensional distributions of (X(ut)) u >o as t — > 00 in 
different regimes. If the response function h is directly Riemann inte- 
grable, then the finite-dimensional distributions of (X(ut)) u >o converge 
weakly as t — > 00. Neither scaling nor centering are needed in this case. 
If the response function is eventually decreasing, non-integrable with an 
integrable power, then, after suitable shifting, the finite-dimensional dis- 
tributions of the process converge. Again, no scaling is needed. In both 
cases, the limit is identified as a collection of independent shot noise 
processes in equilibrium. If (the distribution of) S\ is in the domain of 
^ ; attraction of an a-stable law and the response function is regularly vary- 

ing at 00 with index (3 (with (3 < 1/a or /3 < 1/a, depending on whether 
E Si < 00 or E Si = 00), then scaling is needed to obtain weak conver- 
gence of the finite-dimensional distributions of (X(ut)) u >Q. The limiting 
processes are fractionally integrated stable processes if E S\ < 00 and 
CN . fractionally integrated inverse stable subordinators if E5i = 00. 
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1 Introduction 

Continuing the line of research initiated in [16] , in the present paper, we are 
investigating the convergence of the finite-dimensional distributions of renewal 
shot noise processes. Some work on convergence of renewal shot noise processes 
has already been done by other authors [T5J [3UJ E2] • However, their results do 
not intersect with those obtained here. The special case of Poisson shot noise 
has received more attention, see e.g. [T3 1 l2T | [231 HQ I3"4"]. 

Initially, shot noise processes were introduced to model the current induced 
by a stream of electrons arriving at the anode of a vacuum tube [37]. Since 
their first appearance in the literature, shot noise processes have been used to 
model rainfall [321 E] , stream- and riverflows [2^1 H2] , earthquake occurences 
[40J, computer failures [26J, traffic noise |28j, delay in claim settlement in 
insurance [2TJ [22] , and several processes in finance [35], to name but a few. 
The recent paper [1] offers a list of further references. 

We now start with the mathematical setup. Let £i, £ 2) • • • be a sequence of 
independent copies of a positive random variable £. The distribution of £ is 
denoted by F. By (Sk)km we denote the random walk with initial position 
5*o := and increments Sk — Sfc-i = £fc, k G N. The corresponding renewal 
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counting measure is denoted by N, that is, 

N = 

k>0 

where 5 X denotes the Dirac distribution concentrated at x. We write N(t) 
for iV[0,t], t > 0. By U we denote the intensity measure corresponding to N. 
Hence, U(B) := EN(B) for Borel sets BCK. We write U(t) for U[0, t],t>0. 
Throughout the paper, we denote by h a real-valued, measurable and locally 
bounded function on the positive half-line R + = [0, oo). Further, let 

X{t) := h (t~S k ) = / h(t-y)N(dy), t > 0. (1.1) 

The stochastic process (X(t)) t >o is called renewal shot noise process, h is called 
response function. 

In the recent paper [16], functional limit theorems for (X(ut)) u >o are de- 
rived in the case that the response function is eventually increasing^. The 
motivation behind the present work in general and the use of the specific time 
scaling in particular is the following. First, we intend to obtain counterparts of 
the results derived in [16] for functions h that are eventually decreasing. Sec- 
ond, in a forthcoming publication [18] some results of this paper will be used 
to prove the finite-dimensional convergence of the number of empty boxes in 
the Bernoulli sieve (see [10J for the definition and properties of the Bernoulli 
sieve). Of course, transformations of time other than ut may also lead to use- 
ful limit theorems. For instance, convergence of (X(t + w))u>o ma y be worth 
investigating. Yet another transformation of time has proved important [15] . 
where one only rescales the time of the underlying renewal process, whereas 
the deterministic component runs in its original time scale. 

Unlike in [IE], where functional limit theorems are derived, in the paper at 
hand, we investigate convergence of finite-dimensional distributions only. In 
some cases considered here, the limiting processes do not take values in the 
Skorokhod space of right-continuous functions with left limits which excludes 
the possibility that a classical functional limit theorem holds. However, in 
other cases, if h belongs to the Skorokhod space, so does the limit. Whether 
then there is actually convergence in a functional space remains open for future 
research. 

2 Main results 

As mentioned in the introduction, we centre our attention on the case of even- 
tually decreasing response functions. Let us remark right away that the situa- 
tions where h is eventually decreasing and either lim^oo h(t) = c G (— oo, 0) or 
lim^oo h(t) = — oo and —h(t) is regularly varying at oo with some index (3 > 

1 Notice that we call a function h increasing if for all s < t we have h(s) < hit). We call 
h strictly increasing if s < t we have h(s) < h(t). Analogously, h is said to be decreasing if 
s < t implies h(s) > h(t) and it is said to be strictly decreasing if s < t implies h(s) > h(t). 
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are covered by Theorem 1.1 in [16J. See Remark 12. Ill for more details. Keep- 
ing this in mind our main results mainly treat eventually decreasing functions 
with non-negative limit at infinity. 

Our results fall into two fundamentally different categories. The first type 
of results considers finite- dimensional convergence of the process (X(ut)) u >o 
as t — > oo when no scaling (normalization) is needed. In this case, all ran- 
domness in the limiting process can be described in terms of (copies of) the 
stationary renewal counting process iV* to be introduced below. In the sec- 
ond type of results scaling is needed. As an effect of the scaling, some of the 
fine features of the process (X(ut)) u >o vanish in the limit. Then robust limit 
theorems are obtained in the sense that the limiting behavior only depends 
on the asymptotic behavior of h and the tails of Si- The limiting processes 
are stochastic integrals with integrators being certain stable Levy processes 
or inverse stable subordinators. For instance, if £ is square-integrable, the 
integrator is Brownian motion. 

For the formulation of our main results, we need to introduce further no- 
tation. First, let // : E£. Since £ > a.s., \i is well-defined but may equal 
+oo. Whenever \i < oo and the law of £ is non-lattice, we denote by S$ a 
positive random variable which is independent of the sequence (£fc)fceN and has 
distribution function 

1 f* 

F*(t) := ¥{£%<t} := - / ¥{£>x}dx, t>0. (2.1) 

t 1 Jo 

Moreover, we set S% := Sq + Sk, k G No- The associated renewal counting 
process N* := J2k>o^st nas stationary increments. Equivalently, the corre- 
sponding intensity measure £/*(•) := EiV*(-) satisfies U*(dx) = fi^dx, see 
Subsection 13.11 and f27\ Section III. 1.2] or [53 Section II. 9] for further back- 
ground information and details. 

For stochastic processes (Z t (u)) u > , t > and (Z(u)) u > , we write Z t (u) 
Z(u) as t — > oo to denote weak convergence of finite-dimensional distributions, 
i.e., for any n6N and any selection < U\ < . . . < u n < oo 

(Z t (ui),...,Z t (u n )) A (Z(ui), . . .,Z(u n )) ast^oo. 

2.1 Limit theorems without scaling 

If /j, < oo and F is non-lattice, define 

X* := hm X>(S fc *) (2-2) 

fc>0 

whenever the limit exists as a limit in probability and is a.s. finite. In this 
case, denote by (X*(u)) u >o a family of i.i.d. copies of X*. 

Our first result states that if h is directly Riemann integrable (d.R.i.), 
then the finite-dimensional distributions of (X(ut)) u> o converge weakly to the 
finite-dimensional distributions of the process (X*(u)) u>0 . 

Theorem 2.1. Let h : IR + — > R be directly Riemann integrable and F be 
non-lattice. 
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(a) If fi < oo, then the random series X* converges a.s. and 

X(ut) f 4' X*{u) ast^oo. (2.3) 

(b) If fi = oo, then 

X(t) -> as t ->■ oo. 

Remark 2.2. Since the focus of this paper is on eventually decreasing response 
functions it is worth mentioning that Theorem 12.11 covers the case when h 
is eventually decreasing and improperly Riemann integrable since any such 
function is necessarily d.R.i. 

Example 2.3. Assume that /i < oo and that F is non-lattice. For fixed 
< a < b, choose h(t) := l[o,,6) (t), t > as response function. Then Theorem 
12.11 implies that 

N(t-a) - N(t-b) = J2 h (t-S k ) 4 N*(b-a) as t -> oo. 

fc>0 

Though the one-dimensional convergence in Theorem 12. II is quite expected, 
a rigorous proof is necessary. It is tempting to conclude this from Theorem 
6.1 in [30]. However, the cited theorem does not hold in the generality stated 
there. Regularity assumptions on the function h appearing in the theorem 
above or the function g in the cited result, respectively, cannot be avoided. 
This will be demonstrated in Example 12.61 at the end of this subsection. 

Our second result is an extension of Theorem 12.11 to the situation where 
h is not integrable. In this case, X* is not well-defined and in order to still 
obtain non-trivial finite-dimensional convergence of the process (X(ut)) u >o as 
t — > oo centering is needed. Let 

X (t) := X(t)-n~ l [ h(y)dy, t>0. (2.4) 

J o 

Under suitable assumptions, we obtain finite-dimensional convergence of the 
process (X o (ut)) u>0 as t — > oo. The limiting process is a close relative of 
(X*(n)) u > and is to be introduced next. When \i < oo and F is non-lattice, 
define 

X* := lim (j2h(St)l {sl<t} -- T%)dA (2.5) 

Whenever X* exists as the limit in probability and is a.s. finite, denote by 
(X*(u)) u >o a family of i.i.d. copies of X*. 

Theorem 2.4. Assume that F is non-lattice. Let h : M + — > M be locally 
bounded, a.e. continuous, eventually decreasing and non-integrable. 

(CI) Suppose a 2 := Var£ < oo and 

POO 

/ h(y) 2 dy < oo. (2.6) 
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Then X* exists as the limit in C 2 in (12.51) and 

X Q [ut) f 4 X* {u) ast^oo. (2.7) 
(12. 7p also holds when (X o (ut)) u > is replaced by (X(ut) — KX(ut)) u > . 

For the rest of the theorem, assume that h is eventually twice differentiable 
and that h" is eventually nonnegative. 

(C2) Suppose E£ r < oo for some 1 < r < 2. If there exists an a > such that 
h(y) > for y > a and 



f 



%) r d?/<oc, (2.8) 

J a 

ana^ 

h"(t) = 0(r 2 ~ 1/r ) as t ->■ oo, (2.9) 
then X* is well-defined as the a.s. limit in (12.51) . Further, (12.71) holds. 

( C3) Suppose P{£ > x} ~ x~ a £(x) as x — )■ oo for some 1 < a < 2 and some 
i slowly varying at oo. If there exists an a > such that h(y) > for 
y > a and 

POO 

h(y) a £(l/h(y))dy < oo, (2.10) 



and 

h"(t) = 0{r 2 c{t)- 1 ) ast^oo (2.11) 
where c(t) is any positive function such that 

, te(c(t)) 

lim V . v , n = 1, 2.12 

t^oo C (t) a ^ ' 

then X* exists as the limit in probability in (I2.5P and (12.71) holds. 

Remark 2.5. The cases (C2) and (C3) of Theorem 12.41 impose, besides con- 
ditions on the law of £, smoothness and integrability conditions on h. The 
smoothness conditions may seem rather restrictive but are an essential ingre- 
dient of our proof which is based on an idea we have learned in [20] ■ We 
believe that in each assertion (C1)-(C3), given the respective assumption on 
the law of £, the corresponding integrability condition is close to optimal. In 
a sense, the extra smoothness conditions in (C2) and (C3) are the price one 
has to pay for this precision (we do not claim, however, that the smoothness 
conditions are indeed necessary, using them seems to be a restriction caused by 
the method). For comparison, we mention the following. Assuming nothing 
beyond the standing conditions of the theorem (in particular, not requiring 



2 If h" is eventually monotone, then (|2.9[) and (|2.11l) are consequences of (|2.8[) and (|2.10p . 
respectively. 
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h to be differentiable) we can prove that (12.71) holds under more restrictive 
integrability conditions: 

Ef < oo and f y 1/r d(-%)) < oo 

J[b,oo) 

for some 1 < r < 2, and 

P{£ > x} ~ x~~ a £(x) as x — > oo and / c(y)d(— h(y)) < oo 

J[6,oo) 

for some 1 < a < 2 and some £ slowly varying at oo, respectively, where b > 
is such that h(y) is decreasing on [b, oo). Without going into the details, we 
mention that the conditions Jj 6 ^ ?// r d(— fo(y)) < oo and Jj^ ^ c(y)d(—h(y)) < 
oo are sufficient for the a.s. absolute convergence of the improper integral 
I[b oo)(^*(?/) — y/l 1 )^— h(y)), whereas the conditions ( 12. 8p and (I2.10p are suffi- 
cient for the a.s. conditional convergence of that integral. 

Example 2.6. Let h{t) : = (1 A 1/t 2 ) l Q (t), t > 0, where Q denotes the set of 
rationals. Further, let the distribution of £ be such that P{£ G Qn(0, 1]} = 1 
and P{£ = r} > for any r G Qfl(0, 1]. Then the distribution of £ is non- 
lattice. From (12. ip we conclude that the distribution of Sq is continuous w.r.t. 
Lebesgue measure and concentrated on [0,1]. Therefore, with probability 1, 
Sq takes values in [0,1] fl (M\Q). Since the take rational values a.s., all 
SI take irrational values on a set of probability 1. Consequently, the random 
variable X* = J2k>o ^(^t) ec i ua ls a.s. But in the given situation, X(t) does 
not converge to in distribution when t approaches +oo along a sequence 
of rationals. In fact, for t e Q, X(t) = Y(t) a.s. where Y(t) = J2 k>0 f(t — 
Sk) l{s k <t} with f{t) = 1 A 1/t 2 for t > 0. Therefore, from Theorem 12.11 we 
conclude that 

X(t) = Y(t) A ^2f{S* k ) as t -> oo, t eQ. 

Plainly, the latter random variable is positive a.s. 

Example 12.61 does not only demonstrate that Theorem 6.1 in [30] fails when 
assuming only that lim^ 00 /i(t) = 0. It moreover shows that also Lebesgue 
integrability of h is not enough to ensure (I2.3P to hold. A stronger assumption 
such as the direct Riemann integrability of h is needed. 

2.2 Limit theorems with scaling 

In the case when scaling is needed our main assumption on the response func- 
tion h is regular variation at oo: 

h{t) ~ rH h (t) as t ->■ oo (2.13) 

for some > and some slowly varying at oo. Recall that £h{t) > for 
all t > by the definition of slow variation, see e.g. [5]. Note further that 
the functions h with lim^oc h(t) = b G (0, oo) are covered by condition (I2.13P 
with (3 = and lim^oo £h(t) = b. 
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Theorem 2.7. Assume that F is non-lattice. Let h : R + — > R be locally 
bounded, measurable and eventually decreasing. 

(Al) Suppose a 2 := Var£ < oo and let (W(u)) u > denote a standard Brownian 
motion. If (12.131) holds for some (3 G (0, 1/2), then 



X(ut) -// 1 /"* h(y) dy f . d 



ut 

1 1 ( // ] ( I // , ] / 

u — y) p dW(y) as t — >• oo, 



sja^li Hh(t) J [0, u 

where \i = E£ < oo, whereas if (12 . 1 3[) /io/ds roi/i /9 = ; the limiting 
process is (W(u)) u >q. 

(A2) Suppose a 2 = oo and 

/ n 2 P{£ G dw} ~ £(t) as t ->• oo 

/or some £ slowly varying at oo. Lei c(t) &e any positive continuous 
function such that\im t ->oo ^{ty^ = ^ an ^ ^ (W(u)) u >o denote a standard 
Brownian motion. If condition (12.131) holds with (3 G (0,1/2), then 

// V 2 c(t)h{t) J [0jU] 
whereas if (12 . 1 3[) /io/ds wzt/i /3 = 0, the limiting process is {W{u)) u >q. 
(A3) Suppose 

P{£ > t} ~ t~ Q ^(t) as t -> oo 

/or some 1 < a < 2 and some £ slowly varying at oo. Let c(£) 6e 
any positive continuous function such that lim^oo = 1 and let 

{W{u)) u >q denote a spectrally negative a-stable Levy process such that 
W(l) has the characteristic function 

z i — y exp {-|^| c T(l-a)(cos(7ra/2)+ism(7ra/2)sign(2))}, zeR (2.14) 

where T(-) denotes the gamma function. If condition (I2.13P holds with 
G (0, 1 /a), then 

,x-^l"c{t)h(t) J [0} ^ 
whereas if (I2.13P holds with (3 = 0, the limiting process is (W(u)) u >q. 

Remark 2.8. In Theorem 12. 7\ we only consider limit theorems with regularly 
varying scaling. However, there are cases in which the scaling function is slowly 
varying. The treatment of these requires different techniques and is left for 
future research. 

We do not claim that the next result which is needed in the proof of The- 
orem 12.71 is new. However, with the exception of assertion (Al), which is 
Theorem 3.8.4(i) in [12] . we have been unable to locate it in the literature. 
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Proposition 2.9. The following assertions hold. 
(Al) If a 2 := Var£ < oo, then 



, E \N(t) - urH\ a TMlTrrl 

lim 1 \l—tL = — EW = a*. 

where \i = E£ < oo and W is a random variable with the standard 
normal law. 

(A2) Suppose a 2 = oo and 

/ y 2 P{£ G dy} ~ £{t) as t -> oo 
/or some £ slowly varying at oo. Tnen 



lim 1 w , l - = —r^E W 



t—too 



c(t) fi 3 / 2 V 



,3 



where c(t) is a positive function satisfying lim t _ >00 t£(c(t))/c(t) 2 = 1 ; and 
W is a random variable with the standard normal law. 

(A3) Suppose P{£ > t} ~ t~ a £(t) as t — )■ oo /or some a G (1,2) and some £ 
slowly varying at oo. JTien 

lim ElJVft)-^! = E|W/| = 2r(l-^)|r(l-a)| 1 /"sin(g) 

t->oo C (t) " H 1+1 / a 7T/i 1+1 /« 

where c(t) is a positive function such that lim^oo t£(c(t))c(t)~ a = 1, and 
W is a random variable with characteristic function given by (I2.14p . 

In any of the three cases (Al)-(AS), E\N*{t) - fi~ x t\ ~ E\N{t) - n~H\ as 
t — > oo. 

While all the previous statements of this subsection deal with the case of 
finite fi, our next two results are concerned with the case of infinite \i. Here 
the assumptions on the response function h are less restrictive. 

Theorem 2.10. Let h : M + — > R be locally bounded and measurable. Suppose 
that P{£ > t} ~ t~ a £(t) as t — > oo for some < a < 1 and some £ slowly 
varying at oo, and that h satisfies (I2.13P for some (3 G [0, a]. If a = (3, assume 
additionally that 

hit) , Ut) 

lim ; , = lim = c G 0, oo 

t^oo P{£ > t} t^oo £{t) V ' J 

and if c = oo that there exists an increasing function u(t) such that 

hm - . . . = 1. 
t^oo £(t)u(t) 
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Let (W(u)) u >o denote an inverse a-stable subordinator defined by 

W(u) := inf{t > : D(t) > u}, u>0 

where (D(t)) t > is an a-stable subordinator with — logE e~ tD ^ = T(l — a)t a 
for t > 0. Then 



X(ut) f 4 / (u-j/)-"d%) ast^oc. 
/ H t J >/[o,u] 

Furthermore, there is convergence of moments: 

\i m (li^Jl) k EX(ut) k = e(7 (u-yJ^dWCy) 



u 



[0,u] 

fc! A r(l-/3 + (j -l)( a -/3)) 



n 111 " ( 2 .i5) 



r(l_ a )*JLl r(j(a-/3) + l) 



where T(-) denotes the gamma function. 

Remark 2.11. Let the assumptions concerning £ in Theorem 12.71 or Theorem 
12. lOl be in force with eventually decreasing h and with condition (12.13P replaced 
by —h(t) ~ tP£h{t) as t — > oo for some /3 > and some £h slowly varying 
at oo. No further restrictions on (3 like those appearing in Theorem 12.71 are 
needed. Then the limit relations of the theorems remain valid when the limiting 
processes are replaced by Jj Q Au — y) l3 dW(y), cf. Theorem 1.1 in [16]. 

From Theorem 12.101 it follows that if a = /3 and 

lim — ^ =c6 (0,oo), (2.16) 

then X(t) A- Exp(c _1 ) as t — > oo where Exp(c _1 ) denotes an exponentially 
distributed random variable with mean c. In fact, the one- dimensional conver- 
gence takes place under the sole assumption (I2.16p . In particular, the regular 
variation of neither h(t), nor P{£ > t} is needed. 

Proposition 2.12. Assume that fi — oo and let h : M + — > R + be a measurable 
and locally bounded function which satisfies condition ( I2.16P . Then 

\imEX(t) k = c k k\, keN, 

t— ¥00 

which entails X(t) A- Exp(c _1 ) as t — >■ oo. 



2.3 Properties of the limiting processes in Theorems \2/7_ 
and [STUB 

In this section we find it more transparent to add subscripts in the notation 
of the processes to bring out the dependence on the parameters a and j3. 
Throughout this subsection, we use T(-) to denote the gamma function. 
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Limits in Theorem 12.71 

Assuming in what follows that a = 2 corresponds to the cases (Al) and (A2), 
in particular, that (W / 2(w)) u >o is a Brownian motion, we define the limiting 
stochastic integral 



via the formula 



/ (u-y)^dW a (y), u>0 

J\0,u] 



{u-y)- p dW a {y) := u~ p W a {u) + P / (W a (u) - W a {y)){u-y)-^ dy . 

' [0, u] JO 

(2.17) 

This definition is consistent with the usual definition of a stochastic integral 
with a deterministic integrand and the integrator being a semimartingale. 
However, since \im y ^ u (u — y)^ 13 ^ 1 = oo, it is necessary to check the existence 
of the Lebesgue integral J {W a (u) — W a (y))(u— y)~^~ x dy. Indeed, in view of 
the inequality 



E 



(WM-WMKu-yy^dy 

< / E\W a (u)-W a (y)\(u-y)-P- l dy 
Jo 

= / E\W a (u-y)\(u-y)-e- l dy 
Jo 

= E\W a (l)\ I" (u-y) 1 ^ 1 dy . 
Jo 



The integral exists in the a.s. sense if /3 < 1/a, which explains the restric- 
tions imposed on (3 in the theorem. The processes (Y a> p(u)) u> o can be called 
fractionally integrated a-stable Levy processes. 

Further, if 1 < a < 2, using (12. 14p it can be checked that, for zel, 

log Eexp ( iz (u- yY 13 dW a (y) 

V J[0,u] 
u 

logEexp(i2(M-?/)"^W / " a (l)) dy 
r(l-a)(cos(vra/2) + isin(vra/2)sign(2))|2| a / (u - y)~ aP dy . 



The last integral converges iff /3 E [0, 1/a). Also we infer that, with u fixed, 

Y «Au) = {1 _ ap)1/ WM, (2-18) 

which means that Y a p(u) has a spectrally negative a-stable law in the case 
(A3). It is easy to check that (I2.18P carries over to the case a = 2, in other 
words, Y ai p(u) has a normal law in the cases (Al) and (A2). 
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Assuming that G (0,1/ a), it follows from the defining equation (12. 17p 
that (Y a> p(u)) u> o has a.s. continuous paths. Arguing along the lines of Sub- 
section 2.2 in [IS] one further concludes that (Y a ^{u)) u> Q is self-similar with 
Hurst index 1/a — j3, i.e., for every c > 0, 

(Y a> p(cu)) u>0 =■ (c^-^HUo; 
its increments are neither independent, nor stationary. 



Limits in Theorem 12.101 

In this case, (W a (u)) u > denotes an inverse a-stable subordinator as defined 
in Theorem 12.101 and the limiting integral is 

Y a ^(u):= [ (u-y)-f>dW a (y), u>0. 

J[0,u] 

This integral can be thought of as a pathwise Lebesgue-Stieltjes integral since 
the integrator W a has increasing paths. However, the finiteness of the integral 
should be verified. This is done in the following lemma: 

Lemma 2.13. Let < f3 < a < 1 and u > 0. Then EY aj p(u) < oo. In 
particular, Y a ^{u) < oo a.s. and 

I (u - y)~ p dW a (y) ->• a.s. asp \ 1. 

J {pu, u] 

Proof. It is well known that W a (l) has a Mittag-Leffler law with EH 7 a (l) = 
(r(l — a)r(l + o;)) _1 =: c a . Since the a-stable subordinator is self-similar with 
Hurst index 1/a, (W a (u)) u >o is self-similar with Hurst index a. In particular, 
EW a {u) = c a u a . Therefore, 

= u^EW a (u)+,8 / E(W a (u) - W a (x))(u - x)~^ 1 dx 
Jo 

= c a u a - p + f3c a u a ~P [ (1 -x a )(l -x)-?- l dx < oo. 

Jo 

□ 

The processes (Y ai p(u)) u> o can be called fractionally integrated inverse a- 
stable subordinator s. It is implicit in the proof of Lemma f2. 131 that (I2.17P holds 
also in the given situation. From this representation it follows that {Y a)/3 (u)) u>0 
has a.s. continuous paths. Arguing in the same way as in Section 3 of [TB] one 
can check that {Y a ^(u)) u> o is self-similar with Hurst index a — /3. The latter 
implies that its increments are not stationary. 

Further we infer from [IT] that the law of Y a ^(u) is uniquely determined 
by its moments 

k 



EY „(u) k = u k ^ kl TT r(1 ~ /3+(j ~ 1)(Q ~ /3)) keN (2 19) 

u r(i- a ) fc J- = A T(j(a-B) + 1) > fcei ^ 
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In particular, 

Y a>p (u) = u a ~ p / e- cZ « {t) dt, (2.20) 
Jo 

where c := (a— (3) /a, R is a random variable with the standard exponential law 
which is independent of (Z a (u)) u >o, a drift-free subordinator with no killing 
and Levy measure 

e -t/a 

= (1 _ e - f /a)a+l 1 (0,oc)(t) dt. 

Now we want to investigate the covariance structure of ,3 («))«>()• One 
can check that (12.191) with k = 1 remains valid whenever a G (0, 1) and 
(3 G (—00, 1). Hence the process (Y a! p(u)) u> o is well-defined for such a and j3. 

Lemma 2.14. For any a G (0, 1), (3 G (—00, 1) and < t x < t 2 , 
EY^Y.Ak) = r(a)r(l-ami + a-g) (2 ' 21) 

»*1 



Jo 



Proof. If ti = t 2 ? (I2.2ip coincides with (" 12 . 19[) in the case k = 2 as it must be. 
Now fix ti <t 2 and set 

Ht{y) := / {h - x)- p dW a {x), y G [0, tx], 
H 2 (y) := [ (t 2 -x)-^dW a (x), ye&h}. 

Integrating by parts we obtain 

Ya^Y^ih) = #i(*i)# 2 (ti) 

= [ H l {x)dH 2 {x)+ [ H 2 {x)dH 1 {x) 

J[0,ti] J[0,ti] 

(h - y^dWMih - x)-?dW a (t 2 -h + x) 



[0, ti] J [0, x] 

+ I [ (h - y^dWMih - x)-PdW a (x) 

J[0,h] J[0,x] 

[ (t 2 - y^dWMih - x)- p dW Q (x) 

[0,ti] J[x,t 2 -t 1 +x] 

=: h + I 2 + h. 
According to Proposition 1(a) in [iffi 

E(dW a (x)dW a (y)) = Y2(l^*(l-a) dxdy > ° < X < V < 00 ' (2 ' 22) 



3 Keep in mind that Bingham uses a different scaling. 
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Below we make a repeated use of the formula (see Lemma IA.4j) 

E / f(x)g(y)dW a (x)dW a {y) = [ f(x)g(y) E (dW a (x)dW a (y)) , 



where /, g are arbitrary non-negative measurable functions and A C Borel. 
Using f !2.22p and a change of variable, we arrive at 

EI 3 = b a [\t l -x)^x a - 1 'fo-x-yyPy^dydx 
Jo Jo 

where b a := r(a) _2 r(l — a) -2 . f!2.22j) and changing the order of integration 
followed by a change of variable [z = t 2 — h + x — y) give 

Eli = b a f\t 1 -x)- f3 I {h-yy^h-h + x-yT-'y^dydx 
Jo Jo 

= b a f'ih-y)-^- 1 [\t 1 -x)- f) (h-t 1 + x-y) a - 1 dxdy 



= b a /V-jO'V -1 r "^-y-^-V-Mxdy 
Jo Jo 

-b a [ 1 (ti - y)~ V" 1 / 2 1 {h - y - x)-^"- 1 dx dy 
Jo Jo 

= B a>fi [ \ tl - y)-P(t 2 - yr-Py*- 1 dy -EI 3 , 
Jo 

where B a>p := r( a )ra(f-a)r(i+ a -^ - Analogously 

EJ 2 = 6 a f\h-x)-P nh-yy^x-yr-'y^dydx 
Jo Jo 

= b a f\h-v)-e V a - 1 rih-xY^x-yT^dxdy 



b a I (h ~ 2/)~V _1 / h \h -V- x)- p x a ~ l dx dy 



= B a>p [\t 1 -y) a -f , (t 2 -y)-( 3 y a - 1 dy. 
Jo 

It remains to sum up these expectations. □ 

Similar to the preceding lemma our next result treats both positive and 
negative /3 thereby solving a problem which has remained open in [16] . 

Proposition 2.15. For a G (0, 1) and j5 G (— oo, 1), the process (Y a ^(u)) u> o 
does not have independent increments. 

Proof. We use the idea of the proof of Theorem 3.1 in [29]. Assume that the 
increments are independent. Then, with < t 1 < t 2 < t 3 < oo, 

E{Y a ^(t 2 ) - Y a ^{h)) (Y atP (t 3 ) - Y a ^(t 2 )) 

= E (Y a>j3 (t 2 ) - Y a ^{h)) E (Y a; p{t 3 ) - Y a ,p(t 2 )) 



T(l-(3) 



2 



(tt p -tt p )(tr p -tr p ) =■■ A( tl ,t 2 ,t 3 ). 



r(l-a) 2 r(l + a-/3) 2 
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On the other hand, 



Efo/jte) - y a ,/j(*i)) (i^fo) - ^ 2 )) 
r(i-/3) 

r(a)r 2 (l-a)r(l + a-/3) 

% - y)- p (h - y)"V _1 ((*2 - y) a + (*s - y) a ) 



X 



- / Vi - i/) - ^ - i/)-V -1 ((*i - y) a + (*s - y) a ) 
+ jf 1 (f i - y)^(i 2 - vY V" 1 ((*i - y) a + (fc - y) a ) dy ) 

-f^ =: B(t u t2,t s )- 



2r(l - £)r(l + a - 2/3) 



T 2 (l - a)r(l + a - /3)T(1 + 2a- 2/3) 



By the assumption A(ti,t 2 ,t 3 ) = B(ti,t2,ts) for all t± < t 2 < t 3 . On the other 
hand, 



d 2 A(t u t 2 ,t 3 ) 

and 

d 2 B(t u t 2 ,t 3 ) 



r 2 (i-/3) 



r 2 (l-a)r 2 (l + a-/3) 



v«-/?) 2 (M 3 ) 



a-/8-l 



dhdt 3 



dt 



T(a)r 2 (l -a)r(l + a-/3) 

^-^jf* 1 (* 1 - y )-/'(*3- y )-V- 1 ((ti-y) a + (t3-y) a ) dy 
r(i-/3) 



X 



T(a)r 2 (l -a)r(l + a-/3) 



^(*r^V-y)-^3-«iy)-V- 1 (*?( 1 -i/) a +(*s-*iy) a ) dy 
r(i-/?) 



X 



T(a)r 2 (l -a)r(l + a-/3) 
dt 



- ( - Pt 2 r" J (1 - y) a " V _1 (*3 " tiy)^" 1 d?/ ) 

+ ^ ((a - flf?"' / V - yrV- 1 ^ - iiy)^- 1 dy ) 
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Therefore, 

d 2 B(t u t 2 ,t 3 ) 



dt x dt z 



r(i-/3) 



r(«)r 2 (i - a)r(l + a - (3) 

- 0(2a - P)^- 1 I (1 - y^jT 1 ^ - tiy)^- 1 dy 



Jo 

+ (a - Z?) 2 ^- 1 /\l - y)-V _1 (*8 - tiZ/)^ 1 
Jo 

- (a - 0)(a - /3 - 1)^ / (1 - l/)-V(t 3 - til/) -^ 2 

Jo 

To show that these expressions are not equal, assume that < ti < 1 and set 
t 3 = , z := t 2 . Then the first one does not depend on z. The second, after 
some manipulations, becomes 

r(i-/3) 



D(z) 



r(a)r 2 (l -a)Y{l + a- (3) 

x _ p(2a - (3)z a f\l - y) a " V -1 (l - zy)^ 1 dy 
Jo 

- 0(0 + l)z a+1 I (1 - y) a -Py a (l - zy)-?- 2 dy 
Jo 

+ {a- /3) 2 f\l - y)-V _1 (l - ^) a "^ X d?/ 

_ ( a _^)( a _^_i) z f (l- y )-V(l-^) Q ^ 2 dy 

Jo 



Using the asymptotic expansion (1 — z) a = 1 — az + 0(z 2 ) as z — > (a e R) 
yields 

= 

1 J i»r 2 (l-a)r(l + a-/3) 

x\a~(3) 2 [ (l-y)-P y «-Uy-{3(2a-(5)z a [ (l-y^V^dy 
L Jo Jo 

+ 0(z) , 

as z — > 0. From this expansion it is clear that D(z) depends on z if f3(2a — 0) ^ 
since a < 1. If /5 = then Y^^u) = W^w) and this process does not have 
independent increments as was shown in Theorem 3.1 in [29J. If la = (3 using 
the same idea one can show 



D{z) = ci + c 2 z + 0(z a+1 ] 
where c\c 2 ^ 0, we omit the details. 



□ 
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Formula ( )2.2Up entails that Y aa (u) — R, i.e., all one-dimensional distribu- 
tions of (Y a>a (u)) u> o are standard exponential. This leads to the conjecture 
that the process (Y a)a (u)) u> Q may bear some kind of stationarity. 

Lemma 2.16. The process {Y ata (e u )) ue ^ is strictly stationary with covariance 
function R(s) := E(Y a!Ct (e u ) - l)(Y aia (e u+s ) - 1), s G K given by 



R(s) = ——- -/ {l-e^e^dy, S Gl. (2.23) 

r(a)r(i - at) J\ s \ 

Proof. The strict stationarity follows from the case a = (3 and c < oo of 
Theorem 12.101 Indeed, by that theorem, as t -> oo, (X(uit), . . . ,X(u n t)) A 
c{Y a) a(ui), . . . , Y ata (u n )) for any n G N and any < U\ < . . . < u n , and, for 
any h > 0, the weak limit of (X(u\ht), . . . ,X(u n ht)) is obviously the same. 
To prove (I2.23p . it suffices to show that, for < t 1 < t 2 < oo, 

Er a>Q (*i)y a , a (* 2 ) = l + T^r, r r^a-^-V'dy. 

r(a)r(l - a) J 

The last equality follows from f)2.2ip with a = (3. □ 



3 Preliminaries 

3.1 Stationary renewal processes and coupling 

Our first result in this section shows that the finite-dimensional distributions of 
the increments of the stationary renewal counting process are invariant under 
time reversal. The proof is based on an application of the point-at-zero duality 
(Theorem 4.1 in Chapter 8 of [39]). 

Proposition 3.1. Let /i < oo and F be non-lattice. Then, for every t > 0, 
{N*{t) - N*{{t - s)-) : < s < t) = {N*{s) :0<s<t). 

Proof. For the proof of this proposition, it is convenient to embed the zero- 
delayed random walk (Sk)km i n t° a two-sided random walk (Sk)kez- To this 
end, assume that on the basic probability space, there is an independent copy 
(£-fc)fceN of the sequence (^) fceN - Let S_ k := + . . . + for k G N. 

Further, assume there is a random variable £o which is independent of the 
k G Z\{0} with size-biased distribution 

PfteB} = /z -1 Ef l tteB} , B C R + Borel. 

Finally, let U have the uniform distribution on (0, 1) and assume that U is 
independent of the sequence (^fc)fcez- Define Sq := U^q and S*_ x := —(1 — 
U)£ . Then Sq and have distribution function F* (see e.g. [SU p. 261] 

for a quick proof). Now recall that SI = Sq + S k for k G N and define 
analogously SI := SI 1 + Sk+i for k < — 1. By the first Palm duality (point-at- 
zero duality, Theorem 4.1 in Chapter 8 of [39]), the process iV| := J2kez^s^ is 
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distributionally invariant under shifts. Using this and the fact that (— 5** k )km 
has the same distribution as (5 , fc_i)fceNi we infer for given t > 

{N£[0,s):0<s<t) = (N^[-t,-(t- s)]:0<s<t) = (N£[t - s,t) : 0<s<t). 

This implies the assertion in view of the fact that N*(-) = N%(- D [0, oo)). □ 

Next, we briefly introduce a classical coupling that will be useful in several 
proofs in this paper and which works in the case when /x < oo and F is 
non-lattice. Let (£fc)fceN be an independent copy of the sequence (Ck)keN- Let 
Sq denote a random variable that is independent of all previously introduced 
random variables and has distribution function F* (recall the definition of F* 
from ([21])). Put 

S := and S k := |i + . . . + | fc , k E N . 

Let N be the renewal counting process associated with the process (S k ) k ^ . 
In particular, N(t) := iV[0,t] = G N : S k < t}, t > 0. Further, define 
SI := Sq + Sk, k E N and let N* := Y^k>o^§* denote the associated renewal 

counting process. As usual, put N*(t) := N*[0,t], t > 0. By construction, 
(N*(t)) t >o is a stationary renewal process. 

It is known (see e.g. [27J p. 74]) that, for any fixed e > 0, the stopping time 



r := r(e) 



inf{A; e No : \S k - S* k \ < e}, if inf fceNo \S k - S* k \ < e, 
+oo, otherwise, 



called the time of e -coupling, is a.s. finite. Define the coupled random walk 



^k 



SI, for k < r, 

S k -(S T -S* T ) = S* T + j: k J=T+1 ^, hrk>r + l, 



k E N . Then (S , ^) fceNo = (Sl) ke ^ = (S k )keN - In particular, the random 
process (N*(t)) t >o defined by 

N*(t) := E N : SI < t}, 

is a stationary renewal process. Further, the construction of the process 
(<Sfc)fceN guarantees that 

S* k -e<S k <S* k + e (3.1) 

for k > t. 

Further, one can check that, for any fixed e > and arbitrary < y < t, 
on {r < oo} (hence with probability one), 

^2 1 {t-y<Sk<t} < ^2 1 {t-y-e<S*<t+s} 
k>r k>T 

< N*(t+e) - N*(t-y-e) (3.2) 
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where N*(x) := for x < is stipulated. Similarly, for any fixed e > and 
< y <t, again on {r < oo} (and thus with probability one), 

1 {t-y<s k <t} > Yl 1 {t-y+e<s* k <t-e} 

k>r k>r 

r-1 

= N*( t -e) - N*{t-y+e) - £ l {t _ y+e<s ^ e} . (3.3) 

fc=0 

3.2 Stable distributions and domains of attraction 

Naturally, the asymptotics of the shot noise process (X(ut)) u >o as t — > oo is 
connected to the limiting behavior of as k — > oo. Under the assumptions 
of the limit theorems with scaling, F (the distribution of £) is in the domain 
of attraction of a stable law. To be more precise, for appropriate constants 
Cfc > and bk G R, 

->■ W as A; ->■ oo (3.4) 

where has a stable law S a (o-', 0', fi') that is characterized by four parameters, 
the index of stability a and the scale, skewness, and shift parameters, a', (3', 
and /i', respectively. We refer to for the precise definition of the law 
S a (cr', 0', //) as well as for a general introduction to stable random variables. 
Due to the assumption that £ > a.s., S a (a' , /?', //) will automatically be 
totally skewed to the right, i.e., it will have skewness parameter (3' = 1. 

By changing bk and c& if necessary, it can be arranged that the shift pa- 
rameter fi' equals and the scale parameter a' is as we wish. Particularly, the 
limit can be arranged to be standard normal in the case a = 2 and to have 
characteristic function 

z i — y exp { - |^| c T(l-a)(cos(vra/2) - isin(vra/2) sign(^))}, zeR (3.5) 

in case < a < 2, a / 1. The constants bk and Ck that produce this limit in 
(13 .4p can be described in terms of the distribution of £. 

(Dl) The case a 2 < oo: 

If a 2 := Var£ < oo, then (13.41) holds with bk = kfi, Ck = avk. W then 
has the standard normal law. 

(D2) The case when a 2 = oo, yet there is attraction to a normal law: 

If Jj ot j y 2 P{£ G dy} ~ £(t) for some function £ that is slowly varying at 
+oo, then (13 .4p holds with bk = k\i and the Ck, k e N being such that 
lim^oo = 1. Again, W has the standard normal law. 

C k 

(D3) The case 1 < a < 2: 

If P{£ > t} ~ t~ a £(t) for some 1 < a < 2 and some £ slowly varying 
at oo, then (13. 4 p holds with bk = k\x and the Ck, k e N being such that 
A;P{£ > ca,.} ~ k£(ck)/c^ — >• 1. W then has a spectrally positive stable 
law with characteristic function given by (13. 5p . 
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(D4) The case < a < 1: 

If P{£ > t} ~ t~ a £(t) as t — > oo for some < a < 1 and some £ slowly 
varying at oo, (13 .4p holds with 6 fc = and c k , k e N being such that 
kF{t; > Ck} ~ k£(ck)/c^ — > 1. Again, W has a spectrally positive stable 
law with characteristic function given by (13.51) . Further, W > a.s. in 
this case and its Laplace exponent is given by 

-logip(s) = r(l -a)s a , s > 0. 



Clearly, (Dl) is the classical central limit theorem. (D2) follows from [8\ Theo- 
rem IX.8.1 and Eq. (IX.8.12)]. (D3) and (D4) follow from the lemma on p. 107 
of [7]. (D4) is also Theorem XIII. 7. 2 in [8 J (where Laplace transforms are used 
rather than characteristic functions). 



3.3 Convergence in distribution of the renewal counting 
process 

When F is in the domain of attraction of a stable law of index 1 < a < 2, then 
N(t), centered and suitably scaled, converges in law to a stable random variable 
as t — > oo. This convergence in law carries over to a functional convergence 
which forms the core of our analysis. Here, we give a brief summary of the 
relevant results and the necessary notation. 

Denote by D := D[0, oo) the space of right-continuous real- valued functions 
on [0, oo) with finite limits from the left. It is well known (see, for instance, 
Theorem 5.3.1 and Theorem 5.3.2 in [12] or Section 7.3.1 in (33]) that the 
following functional limit theorems hold: 

. , N(ut) — u^ut , . . 

W t (u) := V J ^ => W{u) ast^oo (3.6) 

where 



• in the case (Dl) (W(u)) u > is a Brownian motion; g(t) = ^/a 2 fi^H and 
the convergence takes place in the J\ topology on D; 

• in the case (D2) (W(u)) u >o is a Brownian motion; g(t) = /i _3 / 2 c(t) where 
c(t) is any positive continuous function such that lim^oo t£(c(t))c(t)~ 2 = 
1; the convergence takes place in the J\ topology on D; 

• in the case (D3) (W(u)) u >o is a spectrally negative a-stable Levy pro- 
cess such that W(l) has the characteristic function given in (12.141) ; 
g (t) = ^^ 1/a c(t) where c(t) is any positive continuous function with 
linif^oo t£(c(t))c(t)~ a = 1; the convergence takes place in the Mi topol- 
ogy on D. 

We refer to [33] for extensive information concerning both the J\ and M\ 
convergence in D. 

For later use we note the following lemma. 
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Lemma 3.2. c(t) and g(t) are regularly varying with index 1/2 in the cases 
(Dl) and (D2), and with index 1/a in the case (D3). As a consequence, given 
A > 1 and 5 G (0, 1/a) (here, a = 2 in the cases (Dl) and (D2)) there exists 
t > such that 

9 -^- < Av 1 /- 5 , (3.7) 

git) ~ 

for all < v < 1 and t > such that tv > to- 

Proof. We only check this for the case (D2), the case (D3) being similar, and 
the case (Dl) being trivial. 

The function c(t) is an asymptotic inverse of 



t 2 ^j^y 2 F{Zedy}^ ~ r 



//(f). 



Hence, by Proposition 1.5.15 in [5], c(t) ~ t 1 / 2 (L#(t)) 1 / 2 where L&(t) is the 
de Bruijn conjugate of L(t) = ^^(t 1 / 2 ). The de Bruijn conjugate is slowly 
varying and hence c regularly varying of index 1/2. (13.71) is Potter's bound for 
g (see Theorem 1.5.6 in [5]). □ 

There is also an analogue of (13. 6p in the case (D4). The functional conver- 
gence 

W t {u) := W{u) as t -> oo (3.8) 

under the Ji topology in D where (VT(m)) u >o is an inverse a-stable subordi- 
nator and g(t) := 1/P{£ > t} was proved in Corollary 3.4 in [29J. 



4 Proofs of the limit theorems without scaling 
4.1 Preparatory results 

We first show that under the assumptions of Theorems 12.11 and 12 A\ the limiting 
variables X* and X*, respectively, are well-defined. It turns out that in the 
case of X*, this is more than halfway to proving one-dimensional convergence 
in Theorem 12.41 

Proposition 4.1. Assume that fi < oo and that F is non-lattice. If h is 
Lebesgue integrable, then X* exists as the a.s. limit and the limit in C 1 in 
( 12. 2p . In particular, X* is integrable, a fortiori a.s. finite. 

Proof. Since fj, < oo, the stationary walk (Sl)km exists. Recall that U*(dx) = 
J2k>o^{^k e dx} = fi' 1 dx. Hence, since h is assumed to be Lebesgue inte- 
grable, we have 

POO 

Ej2\HS* k )\ = / \h(x)\dx < oo, 

k>0 Jo 

from which the assertion easily follows. □ 
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Before we proceed with sufficient conditions for the well-definedness of X* 
we prove two auxiliary lemmata that will be needed later. 

Lemma 4.2. Assume that fi < oo and that F is non-lattice. Further let 
h, hi, /12, • • • be Lebesgue integrable and h n \, h a.e. or h n ~\ h a.e. Define X* 
as usual and X* := J2k>o ^n(Sl), n G N. Then X* — > X* a.s. and in C 1 . 

Proof. Assume without loss of generality that h n j. h a.e. as n — > oo. Then 

1 f°° 

limE|X*-X*| = lim- / (h n (x) - h(x)) dx = 

by the monotone convergence theorem. The asserted a.s. convergence follows 
from the convergence in C 1 together with the monotonicity of X* in n. Indeed, 
/^-convergence implies the existence of a subsequence (nk)k>i along which 
a.s. convergence holds. The monotonicity of X* in n then implies that a.s. 
convergence must hold as n — > oo. □ 

Lemma 4.3. If h : M. — > R is d.R.i., so is h e (x) := sup| y _ x | <e h(y), iGl, for 
each fixed e > 0. 

Proof. For 5 > 0, let 1^ := [nS, {n + 1)5), n G Z. Further, define 
<f(<5) := 8 sup h(x) and a(8) :— 8 > inf /i(a;). 

ft, being d.R.i. means that <x(5) and cr(5) converge absolutely for every 8 > 
and that lim^ot/^) — <z(^)) — 0. Now define o^(S) and of (8) analogously with 
h replaced by h £ . We first show that the sums defining a £ (<5) and of (8) converge 
absolutely. There exists m G N such that m8 > e, hence [n5 — e, (n+l)S+e) C 
VSltn-jl Therefore, for n G Z, 



sup h £ (x) 



n+m 

s E 

k=n—m 



sup h(x) 



This implies the absolute convergence of a £ (8). The corresponding assertion 
for g_ e (S) follows similarly. Further, if x is a discontinuity of h e , then s-eor 
a; + £ must be discontinuities of h. Consequently, since h is a.e. continuous, 
so is h e . Combining this with the absolute convergence of o^(8) and of (5), 
we conclude that h £ is Lebesgue integrable. From the monotone convergence 
theorem it now follows that 

]imqf(8) = I h £ (x)dx = lim ^(5). 

□ 

Proposition 4.4. Assume that /j, < oo and that F is non-lattice. Let h : R + — > 
R &e locally bounded, eventually decreasing and non-integrable and recall that 

x *° ■= t i(E^)i{^}~fM2/)dy). 

^ fc>0 ^ Jo / 
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Under the assumptions of Theorem \2.4\ X* exists as the limit in C 2 in the 
case (CI), as the a.s. limit in the case (C2) and as the limit in probability in 
the case (C3), and in all three cases, it is a.s. finite. 

Proof. Define 

x; : = KSD Mst<t} -- f %) ^y, t > o. 

Our aim is to show that X 4 * converges as t — > oo in the asserted sense. 

We start with the case (CI) and first prove the result assuming that h is 
decreasing on M + . We then have to show that X 4 * converges in C 2 as t — > oo, 
equivalently, 

lim sup E(X; -X*) 2 = 0. 



Since 

xt-x* s = j2 h ( s k)Ms<s* k <t}- E J2 h ^)Ms<s* k <t } 

k>0 k>0 

for t > s, we conclude that 
E(X;-X:) 2 = E(j2 h (St)l {s <s t <t } ) -Uj2h(S* k )t {s<s * k < t} ) 

^ fc>0 ' ^ fc>0 ' 

= E(j2HS* k )l {s<Si < t} ) -flf%)dy 

V fc > / \PJa 

= ®(^h(t-Sl)l {s * <t - s} ^ -(l£h(y)dy 



where the last equality follows from Proposition 13.11 The first term on the 
right-hand side equals 

E Y,Ht-Sl) 2 l { s* k <t- s} +2E h(t-S*)t {s * <t „ s} h(t-S*)l {s;<t „ s} 

k>0 0<i<j 

t—s o rt— * 

2 



h(t-y) 2 dy+- / h(t-y) / h(t-y-x) U(dx) dy 

t 1 JO t 1 JO J(0,t-s-y) 

= - f h{y) 2 dy+- [ h{y) [ h{y - x) U{dx) dy . 

t 1 J a t^Js J(P,y-s) 

Hence 

e(x;-x;) 2 

= - / h{y) 2 dy+- / h{y) / h{y - x)d{U{x)-^ 1 x)dy . 

t 1 J s t 1 J a J(0,y-s) 

Since h 2 is assumed to be integrable, lim^oo sup i>s /* h(y) 2 dy = and it 
remains to check that 

lim sup / h(y) / h(y — x) d(U(x)— [i~ l x) dy = 0. (4.1) 
t>s Js J(Q,y-s) 
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Put H Stt (x) := f x h(x + y)h(y) dy for x E [0, t — s) and H s>t (x) := for 
all other x. Note that H s j(x) is right-continuous and decreasing on [0, oo). 
Changing the order of integration followed by integration by parts gives 

h(y) / h(y — x) d(U(x) — [±~ l x) dy 

J(0,y-s) 

rt—x 

/ h(x + y)h(y) dy d(U{x) — 

(0,t-s) Js 



< / (U(x) - fi-'x) d{-H a , t (x)) 

J{0,t-s) 

< sup \U(x) — ji~ 1 x \ H S! t(0) 



x>0 



sup \U(x) — fi 1 x\ I 

x>0 Js 



Kyfdy. 



It is known (see Theorem XI. 3.1 in [8]) that lim t _ ) . 00 (C/(i) — [i~~ l t) = [i~ 2 (a 2 + 
jj 2 ) < oo, hence sup^Q \U(x) — n~ x x\ < oo, and (14. ip follows. 

Next we assume that h is only eventually decreasing (rather than decreasing 
everywhere). Then we can pick some to > such that h is decreasing on [to, oo). 
Define h(t) := h(to + t), t > 0. Then h is decreasing on R + . Further, the post- 
to walk (S^)fceNo : = i s *N*(t )+k ~ t o)fc G N is a distributional copy of (S* k ) keNo . 
Therefore, by what we have already shown, 

K k>0 ^ J ° 

exists in the £ 2 -sense. Therefore, also 

/ 1 fto+t \ 

x ° = & I EM 5 !) 1 ^}-- / %) d ?0 

^ fc>0 " ^° ' 

exists in the £ 2 -sense. 

Now we turn to the cases (C2) and (C3). Again, we begin by assuming 
that h satisfies the assumptions of the theorem and is decreasing and twice 
differentiable on M + with h" > 0. The proof is divided into three steps. 

Step 1: Prove that if, as n — > oo, U n := Y^k=o(^(^k) ~ h(fik)) converges a.s. 

in the case (C2) or converges in probability in the case (C3), then, as 
t — > oo, J2k>o h{Sk) ^-{S'*<t} —l^ 1 Jq h(y) dy converges in the same sense. 

Step 2: Prove that if the series Ylj>o(£j ~ A 4 ) Tlik>j h'(fik) converges a.s., then, as 
n — > oo, U n converges a.s. in the case (C2) and converges in probability 
in the case (C3). 

Step 3. Use the three series theorem to check that, under the conditions stated, 
the series ^>o(£j ~ /•*) ^fc>j h'(fik) converges a.s. 
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Step 1. 

Case (C2). Assume that U n converges a.s. Then, by Lemma |A.5[ the se- 
quence Ylk=o h(St)~ Z 1 " 1 JiT™ h(y) dy converges a.s., too. Since lim^oo N*(t) = 
oo a.s., we further have that £)fcL® 1 ^(^fc) — ^ 1 Jo* 1 M?/) converges 



a.s. as t — > oo. To complete this step, it remains to prove that 



lim 

t— ¥00 



n{N*(t)-l) 



Kv)&y- I Kv)dy 



a.s. 



(4.2) 



To this end, write 



h(y)dy- / h(y)dy 
Jo 

h(y) dy 

< \fi(N*(t) - 1) -t\h(n(N*(t) - 1) At), 



(4.3) 



where the inequality follows from the monotonicity of h. By Theorem 3.4.4 in 
[12], Ef < oo implies that 



N(t) - n~ l t = o{t 1/r ) a.s. as t oo, 
where it should be recalled that 

N(t) := inf{£; G N : S k > t} = M{k eN:^-5 *> t}. 

Since 



(4.4) 



N*(t) = l{s* <t } +N(t-S* )l {s *< t} 



a.s. 



and Sq is a.s. finite, we infer 



N*(t) - iT x t = o(t 1/r ) a.s. as t -> oo. 

This relation implies that the first factor in (14. 3 j) is o(t 1 / r ), whereas the second 
factor is o(t _1 / r ) as t — > oo. The latter relation can be derived as follows. 
First, in view of (12.81) and the monotonicity of h, we have 

h(t) = o(r 1/r ) ast^oo. (4.5) 

Second, by the strong law of large numbers for N*(t), we have 

[n(N*(t) - 1)] A t ~ t a.s. as t ->■ oo. 

Altogether, (14. 2 p has been proved. 

Case (C3). Assume that U n converges in probability. In view of Lemma [A. 51 
we conclude that, as t — > oo, X/fe=o^ h(S£) — {T 1 Jq^^ h(y) dy converges in 
probability, too. 

From (12TT0|) it follows that h{t) a i{h{t)- 1 ) = o(r x ). This and (l2TT2|) imply 
that 



= lim th(t) a £(h(t) 

t—>oc 



-1\ 



Hm c(trh(t) J -^^ 



P{e > h(t)- 1 } 
££o P{£ > c {t)} 



lim 
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From this, using the monotonicity and regular variation of x h- >■ P{£ > x}, we 
conclude that 

lim c(t)h(t) = (4.6) 

t— too 

The latter relation implies that lim^oo h(t) = 0. Hence 

lim / h(y)dy- / h(y)dy = 0. 

\Jo Jo J 

Further, 

Af W A(L^j + i) = _ and Um g^m±i) = „ ,, 

t^oo t ^ t^oo N*(t) A ([t/fl\ +1) 

by the strong laws of large numbers for renewal processes and random walks, 
respectively. Hence 

SW*(t)A([t/M]+l) 



Using this and (14. 5 p we obtain that 



1 a.s. 



L*/^J N*(t)-1 (N*{t)-l)V[t/^ 

E h ( s *k) - E ^*) = E M 5 *) 

fc=0 fc=0 fc=A r *(t)A(Lt//iJ+ 1 ) 

< |iv*(t) _ 1 _ \t/n\ \h(S N * {mvm+1) ) 
= \N*(t)-l-[t/^\\o(l/c(t)). 

From (13.61) for u — 1 in the case (D3) in Subsection 13 . 21 we get that ^ A " ! ~''~' L 



c(t) 

converges in distribution to an a-stable law with characteristic function given 
by (l2TT4"p . This entails 

[*//*] jv*(*)-i 

HS* k ) ~ E ^ ^ ^ t ^ oo. 

fc=0 fc=0 

Combining pieces together gives the needed conclusion for this step. 

Step 2. For each k e N, by Taylor's formula, there exists a 8 k between S% 
and fik such that 

h{Sl)-h{iik) = h'^k)(S* k -^k) + h"(6 k )(S* k -^k) 2 . 

Set 

1 " 

J » := -E^'W^-^) 2 

fc=i 
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and write 



U n -h(S*) +h(0) = Ilk) + I n 

fc=l 

n n n 

= S*Y,h'(fik) + ri^h'frj) + I n 

k=l k=l j=k 

n n 

= ^E^vo+E^-^E^') 

fc=l k=l j>k 

-{S n -fin) E h'(fik) + I n . (4.7) 

fc>n+l 

Since — /i' is decreasing and nonnegative we have 

/CO 
-ti{fiy)dy = iT x h(jm) < ^-h'^k). (4.8) 

for all n. Using the first inequality in ( 14. 8 p and the fact that lim^oo h(y) = 0, 
one immediately infers that the first summand in the penultimate line of (14. 7p 
converges as n — > oo. The a.s. convergence of the second (principal) term is 
assumed to hold here. As to the third and fourth terms, we have to consider 
the cases (C2) and (C3) separately. 

Case (C2). By the Marcinkiewicz-Zygmund law of large numbers [6l Theorem 
2 on p. 125], 

S n — fin = o{n l l T ) as n — > oo a.s. (4.9) 

Therefore, in view of (14.51) and (I4.8p . the third term converges to zero a.s. 
Further, lim^oo k~ x d k = fi a.s. by the strong law of large numbers. Hence, in 
view of ([MP , 

h"(0 k ) = 0(6~ 2 - 1/r ) = 0(kr 2 - 1/r ) asfc^oo. 

From ( I4.9p we infer 

h"(e k )(S* k - fik) 2 = o(k- {2 - l/r) ) a.s. as k ->• oo, 

which implies that I n converges a.s. asn-> oo, for 2 — 1/r > 1. Hence the a.s. 
convergence of J2 k >i(^t ~ A 4 ) J2j>k^'(M) entails that of U n . 
Case (C3). By the discussion in Subsection 13.21 S ™^ n converges in distri- 
bution to an a-stable law. Hence, in view of (14. 6 p and ( 14. 8p . the third term 
converges to zero in probability. 

Now pick some < e < a — 1. Since E^ a ~ e < oo, we conclude (again from the 
Marcinkiewicz-Zygmund law of large numbers, [HI Theorem 2 on p. 125]) that 
(14. 9 p holds with r = a — e. Using (12.111) and the facts that 9 k ~ fik a.s. and 
that c(t) ~ t 1 / Q L(t) for some slowly varying I (see Lemma [3. 21) . we conclude: 

h"(6 k ) = 0{8 k 2 c{9 k )- x ) = 0(k~ 2 ~ l/a L(k)~ 1 ) a.s. as k ->• oo. 
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Therefore, 

h"{6 k ){S* k - fik) 2 = o(A;" (2 "^) ) L(fc)- 1 ) a.s., k ->• oo, 

which implies that the fourth term I n converges a.s., as for sufficiently small 
e,2 ? +£ , > 1. Hence we arrive at the conclusion that the a.s. convergence 

' a(a— e) 

°f 2~2k>i(£k ~ J2j>k h'iw) entails convergence in probability of U n . 
Step 3. Set 

c k := ^ -h'iw) and ( k := -c k {£ k - //), k E N . 
Case (C2). Condition f[2TH|) ensures that J2k>i h(nk) r < oo. In view of (jOl) . 

fe>i fc>i \i>fc / 

< /i~ r E |£ — /i| r ^ h(fi(k - l)) r < oo. 



k>l 



Hence the series Ylk>i ^ k converges a.s. by Corollary 3 on p. 117 in [5]. 
Case (C3). By the three series theorem [HJ Theorem 2 on p. 117], it suffices 
to show that the following series converge 

^P{|C fc |>l}, J>(G% fe |<i}) and ]TVar(Ca { |c fc |<i})- 

k>\ k>l k>\ 

By Markov's inequality, the first series converges if 5^fc>i-^(ICfc| ^{|Cfcl>i}) con " 
verges. Since E^- = for all j > 1, the second series converges if and only if 
the series ^2 k>1 ^(k l{|G=l>i} converges. By Theorem 1.6.5 in [5J, 

E(|C fc | % h |>i}) = c k [ xF{\£-fi\ Gdi} ?— c l^) asfc^oo. 

J[c-\oo) 

Hence, recalling (|4~8]) and (1210)1 . 

S)E(|Cji,|% fc |>i}) < oo. 
fe>i 

Further, by Theorem 1.6.4 in [5J, 

E(4 2 l { | Cfc |< 1} ) = c 2 k ! x 2 F{\£-fi\edx} ~ -^^(c- 1 ) asfc^oo. 

Again using (14. 8p and f l2.10p . this entails 

^Var(G %,!<!}) < ^E(C, 2 l { | Cfc |<i } ) < oo. 



fe>i fc>i 



Finally, we need to prove that the assertion also holds for h that are only 
eventually decreasing and eventually twice differentiate with h" > eventu- 
ally. Indeed, for any such h, there is some to > such that h is decreasing 
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and twice differentiable on [to, oo) with h" > on [t , oo). Using this to, 
define h and (S k )keN as i n the proof in the case (CI). Notice that with 
h, also h satisfies the assumptions of the theorem, for instance, in case (C3), 
h"(t) = h"(t +t) = O((t + t)- 2 c(t + ty 1 ) = 0(* -2 c(t) -1 ) ast ->■ oo. Now one 
can argue as in the corresponding part of the proof in the case (CI) to conclude 
that X* exists as the a.s. limit or the limit in probability, respectively. □ 

4.2 One-dimensional convergence 

The proofs of Theorems 12.11 and 12.41 are preceded by the corresponding state- 
ments on one- dimensional convergence and their proofs. 

Proposition 4.5. Assume that F is non-lattice and let h be d.R.i. 

(a) If /i < oo, then the random series X* converges a.s. and 

X(t) Ax* ast^oo. 

(b) If ii = oo, then 

X(t) ->• as t — > oo. 

Proof. Assertion (b) is a straightforward consequence of the key renewal theo- 
rem. We thus immediately turn to assertion (a) and assume \i < oo. Let e > 
and r = r(e) be defined as in Section I3TT1 Recall that r < oo a.s. Further, let 
h £ {t) := sup| s _ t | <e h(s), t > 0. Since h is d.R.i., we have 

C := sup\h{t)\ E [0,oo). 
t>o 

Then, using (13. ip for t > e and its consequence 

I !{s fc <t} - %*<*} I < ^ { t-s<s*<t+e} for k>T, 

we infer: 

r-1 

X (t) < Kt-S k ) l {Sk < t} + ^(t-SD Ms k <t} 

k=0 k>r 
r-1 

= h (t-Sk) Ms k < t} + h£ (t-s*k) h§t<t} 

k=0 k>r 

+ J2h £ (t-S* k )(l {Sk < t} -l { s l < t} ) 

k>r 
r-1 

< h (t-Sk) i {Sk <t } + Y h £ (t-s* k ) i mt} +c Y V e<S*<t+e} 

k=0 k>r k>r 

r-1 

< 5>(f-S fc ) l {Sk < t} -h £ (t-S* k ) + Y h £ (t-S* k ) l {§ ^ t} 

k=0 k>0 

+ C(N*(t+e)-N*(t-e)), 
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where in the fourth line the inequality h £ (t) < C, t > 0, has been utilized. 

Regarding the last term, we have N* (t+e)-N* (t-e) = N*(2e) -> cL.S. cLS E |0. 
Since h is d.R.i., so is h £ , by Lemma fl~3l Hence lim^oo h(t) = lim^oo h £ (t) = 
0, and the first summand in the penultimate line of the displayed equation 
tends to cL.S. cLS t — » oo. Regarding the second term of the displayed equation, 
(13. ip and Proposition 14.11 give 



k>0 k>0 k>0 

Further, the d.R.i. of h implies that h is a.e. continuous, which in turn implies 
that h e 4 h a.e. as e 4 0. Lemma [4.21 thus gives that lim^o^ 6 '* = X* a.s. We 
conclude that 

limsup P{X(t) > x} < ¥{X* > x} 

t— >oo 

for every continuity point x of the law of X*. 

To be more precise, let (e n )neN be a sequence with e n 4 as n — > oo. Let 
x be a continuity point of the law of X* and x — 5 (5 > 0) be a continuity 
point of the law X* and of the laws of X £n '* . (The set of these S is dense in 
E.) Then, 

limsup F{X(t) > x} 

< limsupp{£(/i(t-50l { 5 fc < t }-^(t-^)l { sj< t} ) > 5/4 
+ limsup P{C(iV*(t+£ n )-iV*(t-£ n )) > 5/2} 

+ hmsupP { £ h e »(t-St) t {§i < t} >x-s) 

= P{X £ "'* >x-5} + P{CiV*(2£ n ) >5/2}. 

As n — >■ 00, the second probability goes to zero, whereas the first tends to 
¥{X* > x — 5}. Sending now 5 4 along an appropriate sequence, we arrive at 
the desired conclusion. Corresponding lower bounds can be obtained similarly, 
we omit the details. □ 

Proposition 4.6. Assume that // < 00 and that F is non-lattice. Let h : R + — > 
K be locally bounded, a.e. continuous, eventually decreasing and non-integrable 
with lim^oo h(t) = 0. If X* exists as a limit in probability, then 

X (t) A X* as t ->■ 00. (4.10) 

In particular, (14.101) holds under the assumptions of Theorem 2-4 Further, 
X(t) - EX(t) Ax* as t ->■ 00 in the case (CI) of Theorem[2~4. 



Proof. Since h is assumed to be eventually decreasing, there exists a t > such 
that h(t) is decreasing on [to, 00). Define h\{t) := h(to) l[Q )to ](t)+h(t) l(t 0)O o)(0 
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and h 2 (t) := h(t) — hi(t). Consequently, X Q (t) = Xi fi (i) + X 2 ^ (t), t > where 

1 /"' 

*i,a(*) := 22hj{t-S k )l {Sk < t} — hj^dy, j = 1,2, 
fc>0 ^ - 70 

and /ii is nonnegative and decreasing, and /12 is d.R.i. The idea is to con- 
clude convergence of X 2o (t) as in the proof of Proposition 14.51 and to use the 
monotonicity of h% to infer convergence of X l o (t). However, convergence in 
distribution of Xi >0 (t) and X 2 ^ (t) does not imply convergence in distribution 
of their sum. This is why we will treat the two terms simultaneously. 
We will only prove that 

limsupP{X (t) > x} < F{X* > x} (4.11) 

t— >oo 

at any continuity point x of the law of X*. The converse inequality for the 
lower limit can be obtained similarly. As in the proof of Proposition 14. 5\ we 
use a coupling argument but for technical reasons, the coupling differs slightly 
from that introduced in Subsection 13.11 Define the (a.s. finite) stopping time 

a ■= a{e) := inf{k E N : S* k - S k E [0, e]}. 

Then we can define the coupled random walk (Sl)keN as in Subsection 13. II but 
with t replaced by a. This has the advantage that the estimate (13. ip can be 
replaced by S k < S k < Sk+e for all k > a. This choice of coupling is convenient 
for the derivation of upper bounds since together with the monotonicity of hi 
it implies that 

h(t-S k ) < h^t-Sl) for all k > a. (4.12) 
Our starting point is the following representation for X(t): 

cr-1 



X(t) = ^h(t-S k )l {Sk < t} + ^h l (t-S k )l {Sh < t} + Y,h2(t-S k ) l {Sk < ty . 

k=0 k>a k>a 

(4-13) 

Using (I4.12p and the monotonicity of hi, we infer: 
Y^hi(t-S k ) l {Sk <t} 

k>a 

{t<§ 



<<t+e} 

k>cr k>cr 



< N 



^h^t-SDl^y+himN^t+e)-^^)). (4.14) 

fc>0 

With h £ 2 (t) := sup| s _ t | <£ h 2 (s) and C := sup 0<s<tf) |/i 2 (s)|, we infer as in the 
proof of Proposition 14 51 



J2 h 2(t-S k ) l{S k <t} 

k>a 

cr-1 

< YM 1 -^ hsm-Y^-^) l {J j< t} +C(iV*(t+e) -#*(*)). 

fc>0 k=0 

(4.15) 
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Now fixiGK and 5 > 0. Combining (14.131) . (I4.14p and (I4.15p . we conclude 
limsup ¥{X (t) > x} 



t— >oo 



< limsuppj V^t-^)!^}-- / h 1 (y)dy 

+ ^-St) ^ { s;<t } -- / h s 2 (y) dy > x - 5 1 
fc>0 ^ ^° J 

+ limsuppj ]T (Kt-S k ) l {Sk <t} -h £ 2 (t-S* k ) l {§m ) > 6/3) 
+ limsup F {(h^O) + C)(N*(t+e)-N*(t)) > 5/3} 

t— >oo 

+ P S^j\hl(y)-h 2 (y)) dy > 5/3^ (4.16) 

The event appearing under the last probability is deterministic. Hence, when 
e is small enough, the last probability equals 0, for h\ j. h 2 a.e. as e I 0. Since 
h(t) — > as t — > 00, we further have 



0--1 



hm J2(Kt-S k ) l {Sk < t} -h e 2 (t-~Sl) l {§l<t} ) = a.s. 

— inn ' * L — 1 



t— >oo 

k=0 



This implies that the term in the fourth line of (I4.16P equals 0. Regarding the 
term in the penultimate line of (I4.16p . we have 

limsu P P{(/ii(0)+C)(iV*(t+£)-iV*(t)) >5/3} = P {{h 1 {0)+C)N*(e) > 5/3}. 

t— >oo 

This tends to as e — > 0. It remains to deal with the principal term, the first 
term on the right-hand side of (I4.16p . By Proposition 13.11 



Y,h(t-S* k )l {§ t<t} -^ [ h 1 (y)dy + Y / m-S* k )t { s i < t} -- I h 2 (y)dy 
k>o ^ Jo k>o 

5>iOSJ)l{sj<t}-- [ h 1 (y)dy 



fc>0 



+ Y,hl(S* k )l {sl < t} -- fh e 2 {y)dy 

A* JO 



k>0 

XI + X 2 * as t 00. 

The existence of XI follows from the existence of X* as a limit in probability 

and the existence of the a.s. limit lim^oo J2k>o ^(^t) ^-{s;<t} ~h Jo^iy) dy 
which is secured by Proposition 14.11 (using that h 2 is d.R.i.). The existence of 
X 2o follows from Proposition 14.11 (using that h 2 is d.R.i.). From Lemma [4.21 
and the fact that h e 2 \. h 2 I 0, it follows that 

t 
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Hence \im £ ^ (Xl + -^f'*) = X* a.s. Now one can argue as in the end of the 
proof of Proposition 14.51 to infer (14.111) . 

It follows from Proposition 14.41 that the assumptions of Theorem 12.41 are 
sufficient for fETTU]) to hold. In the case (CI) of Theorem^! lim^oo | EX(t) - 
^ 1 Jo ^(^) d?/ 1 = by Corollary 3.1 in [19]. Hence, the limiting distribution 
of X(t) — EX(t) as t — > oo is the same as that of X*(t). □ 



4.3 Finite-dimensional convergence 

It remains to extend one- dimensional convergence to finite-dimensional con- 
vergence. This is done in this subsection. 



Proof of Theorem \2.1\ We have to show that for all < u\ < . . . < u n < oo, 
the random vector (X(uit), . . . , X{u n t)) converges to (X*(ui), . . . , X*{u n )) in 
distribution as t — )■ oo. 

Assume that n = 2. Without loss of generality we may take U\ = 1. We 
further write u for u 2 > 1, set nil = (1 +u)/2 and let m 2 G (m^u). For t > 0, 
set 

AT(mit)-l 

X x {ut) := ^ h(ut-S k ) t{ Sk <ut} and X 2 (ut) := ^ h{ut - S k ) l {Sk <ut} ■ 

k=0 k>N{mit) 

Clearly, X{ut) = X x (ut) + X 2 {ut) for all t > 0. 
We first prove that 

Xx(wt)4o ast^oo. (4.17) 

For every e > there exists an c = c(e) > such that J^ 00 |/i(y)|dy < e. 
Setting /z c (t) := h(t) l[ Cj00 )(t), we have, for t large enough, 

AT(TOlt)-l 

E|Xi(«t)| < E V — Sfc)| = / \h(ut-y)\U(dy) 



k=0 



< / \h c (ut-y)\U(dy) 

'[0,ut] 



t— >oo 



/OO /'OO 
IMs/)l<H/ = y l%)|dy < e. 



Sending e I finishes the proof of (I4.17p . 
Our next purpose is to show that 

F{X(t) < a,X 2 (ut) < b} ¥{X* < a}¥{X* < b} (4.18) 

as t — > oo for continuity points a, b G M of the law of X*. Write the probability 
on the left-hand side of (14. 18[) as follows: 

¥{X(t) < a,X 2 (ut) < b} 

F{X(t) < a,X 2 {ut) < b,S N{mit) G dy} 

(mit, oo) 

: Ji(t) + J 2 (t). 



/ . 


.. + / ...) 


' (mit, m,2t] 


J (mzt, oo) 
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Clearly, < J 2 (t) < f{S N{mit) > m 2 t} = f{S N ( mit ) -mit > (m 2 -mi)t} -)■ 



as t — > oo since SV(mit) — m \t So anc ^ ( m 2 — — > +00 as i — > 00. For 
Ji(t) we may write: 

Ji(t) = [ ¥{X(ut-y)<b}F{X(t)<a,S N(mit) edy} 

J (mit, m.2t] 

where we have used that (Sk+N( mi t) — SN<mit))keNo nas the same distribution 
as {S k )km and is independent of {S k ) < k < N ( mit ). Further, 

Jx(t) = P{X* < b} I F{X(t) < a, S N(mit) e dy} 

J (mit, m,2t] 

+ J (¥{X(ut-y) <b}- ¥{X* < b}) ¥{X(t) < a, S N(nilt) e dy} 

(mit, m2t] 

=: Ju(t) + J 12 (t). 

The integral in the first summand converges to P{X* < a} by Proposition 14.51 
since a is a continuity point of the law of X* and ¥{m\t < SV( mi t) < m 2 t} — > 1 
as t — > 00. To show that J\ 2 {t) converges to zero, write 

\Mt)\ 

¥{X(ut -y)<b}- F{X* < b} [ nSN( mi t) e dy} 

J (mit, m2t] 

F{X(y) <b}- ¥{X* < b} , 



= sup 

y£[mit, m2*] 

< sup 

y>(u—m2)t 



which goes to zero since (u — m 2 )t — > 00, as t — > 00, in view of Proposition 
14.51 The proof of (14.181) is complete. Now the desired result for the case n = 2 
follows from (14.171) . (I4.18P and Slutsky's lemma. 

The case of general n e N can be treated in a similar manner by con- 
ditioning the probability F{X(uit) < a±, . . . , X(u n t) < a n } on the values 
of (Sjv(mit)) ■ ■ ■ j ^N(m„-it)) at appropriately chosen middle points u% < rrii < 

Ui+l- □ 



The scheme of the proof of Theorem 12.41 is the same as that of the proof 
of Theorem 12.11 above. On the other hand, it differs in many details which is 
why we decided to include it in the paper. 

Proof of Theorem 2.4 As in the case of Theorem 12. 1[ we will prove this the- 
orem only for n = 2 and assume that U\ = 1 and u := u 2 > 1. Let 
pit) := ^T 1 Jq h(y) dy and set mi := (1 + u)/2, z 2 (t) := mit + r(i) where r(t) 
is some function to be specified below. Decompose X Q {ut) := X{ut) — p{ut) 
as follows 

N( mi t)-l t 



X {ut) 



/"^'IT 1 -, nut \ 

J2 h(ut-S k )-- / h(y)dy 

V k=Q A 4 J (li-mi)t / 

( ^ h ( ut - S k) 1 {s k <ut} ~p{{u - nii)t) J 



+ 

• k>N(mit) 

Y 1 (t) + Y 2 (t). 
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Similar to the proof of Theorem I2.1[ we conclude that it is enough to show 
that 

Yx(t) A 0, 

and 



V{X(t) <a + p(t),Y 2 (t) <b} F{X:<a}F{X* Q <b}, 

as t y oc for all a,b GK that are continuity points of the law of X*. 
We begin by proving (14.191) . Using integration by parts, we infer 



(4.19) 
(4.20) 



N( mi t)-1 1 t 

( Y K ut ~ S k) ^{S k <ut} — / 

V fc=0 M Jfu-m^t 

h(ut-y)d(N(y)-y 

[0,mit] V ^ 

h{ut) + h((u - mi)*-) ((N(mxt) - 

V /i 



h(y) dy 



J 



h(ut-) 



N{y)-^) dh(ut-y) 



(0,TOlt] 

/i(ut) - h(ut-) + - mi)*-) (N(mxt) 

ut-y 



[(«-mi)i, ut) 



N(ut - y) 



d(-%)) 



(4.21) 



for large enough *. We now consider two situations: 

Cases (CI) and (C3): We invoke the estimate E \N{t) - i| < K x + K 2 c{t) 
which holds for all * > and some fixed Ki, K 2 > 0, see Proposition 12.91 Here 
c(*) is chosen as \ft in the case (CI) and in the case (C3) it is as stated there. 
Then 



E|Yi(*)| < h((u — mx)t) E N{mit) — 



mi* 



+ o(l) 



+ 



E 



((«— rai)t, ut] 



N{ut - y) 



ut-y 



d(-%)) 



< h((u-mx)t)(Kx + K 2 c(mxt)] + o(l) 

(#i + K 2 c( U *-y))d(-%)). 



+ 



((«-mi)i, ut] 



Note that since c is regularly varying and in view of (14. 6p we have, for arbitrary 
k, X > 0, 

lim c(Kt)h{Xt) = lim c(t)h(t) = 0, (4.22) 

t— >oo t—too 

in the case (C3). The same relation holds in the case (CI) since h{t) = o(t~ l l 2 ) 
in view of (12. 6 j) and the monotonicity of /i. Recalling that mi = (l + w)/2 < u 
and using (I4.22p we infer that the first summand in the estimate for E |Yi(*)| 
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above converges to zero as t — > oo. Further, again using (I4.22p . 
/ (^!+if 2 c(«t-y))d(-%)) 

J ((u—mi)t. ut] 



= K 2 / c{ut-y)d{-h{y))+o{l) 

J ((u—mi)t, ut] 

< c(mit){h((u - mi)t) - h{ut)) + o(l) 

as t — t- oo. 

Case (C2) : In this case E £ r < oo. Thus, as a consequence of the Marcinkiewicz- 
Zygmund law of large numbers for N(t), see (14. 4p . 

r sup 0<s<t \N(s) - // _1 s| 

hm — -; = (J a.s. 

t->oo t 1 / r 

From the monotonicity of h and (12. 8p it follows that h{t) = o(t~ 1 / r ) as t — >■ oo. 
Hence 

lim sup N(s) — = a.s. 

t^oo 0<s<\t 

for arbitrary k, A > 0. Using this in (I4.2ip implies that Yi(t) — > a.s., in 
particular also in probability. 

We now turn to the proof of (I4.20p . Write the probability on the left-hand 
side of (I4.20P as follows: 

¥{X(t) <a + p(t),Y 2 (t) < b} 

= [ P{*(t) < a + p(t), Y 2 (t) < b, S N(mit) e dy} 

J (mit, oo) 

:J 1 (t) + J 2 (t). 



1 • 




t(mit,z 2 (t)] 


J(z 2 (t),oo) J 



Clearly, < J 2 (t) < F{S N[mit) > z 2 {t)} = ¥{S N{mit) - mi t > r{t)}. The latter 
probability tends to as t — > oo whenever 



r(t) oo as t ->■ oo (4.23) 



since SN( mi t) - mit -)• S^. 
For Ji(i) we may write: 



Ji(t) 

= / F{X(t) <a + p{t), S N(rnit) E dy, 

J(m- l t,z 9 (t)] 



'(mit, z 2 (t)] 
oo 

h ( ut -y-(Sk-S N{mi t)))l{s k -s N{mit) <ut-y} < b + p((u-mi)t)} 

k=N(m 1 t) 

= [ ¥{X{ut-y) < b+p{{u- mi )t)}¥{X{t) < a+p{t), S N{mit) e dy}, 



36 



where the last equality follows from the inequality t < m\t and the fact that 
(Sk+N(mit) - S N ( mit )) k £No has the same distribution as (Sfc) feeNo and is inde- 
pendent of (S k ) <k<N{rnit)- Further, 

Ji(*) = F{X* Q < b} [ F{X(t) <a + p(t),S N{mit) G dy} 

J{m 1 t,z 2 (t)] 

+ / (F{X(ut-y) < b + p((u - mjt)} -F{X* < b}) 

J{m 1 t,z 2 (t)] 

x F{X(t) <a + pit), S N{mit) G dy} 
=: J n (t) + J l2 (t). 



When (14.231) holds, then F{mit < S N ( mit ) < z 2 (t)} ->■ 1 as t ->• oo. Conse- 
quently, an application of Proposition 14.61 shows that the integral in the first 
summand converges to P{X* < a}. To show that Ji2{t) converges to zero, 
write 

< sup \¥{X{ut-y) <b + p(ut-mxt)} -F{X* <b}\ 

m 1 t<y<Z2(t) 



x / F{S N{mit) G dy} 

'(mit,Z2{t)] 

< sup | F{X (ut-y) < b+piut-m^-piut-y)} -F{X* < b}\ 

m\t<y<Z2(t) 

/•(iir^mi)t 

sup \F{X a (ut-y) < b + fj,- 1 h(x)dx-F{X* < b}\. 

m\t<y<Z2(t) J ut^y 

Using the fact that h is eventually nonnegative, we proceed as follows: 



|J 12 (*)| < sup F{X {ut-y)<b}-F{X:<b} 

m 1 t<y<Z2(t) 

f put—mit 

+ sup Fib < X {ut-y) <b + n" 1 I h(y) dy 

m\t<y<Z2(t) I Jut—y 



< sup 

y>ut—Z2 (t) 



F{X (y)<b}-F{X* <b} 



( put—mit 

+ sup F lb < X Q (ut-y) <b + fi- 1 h(y)dy\. 

m\t<y<Z2(t) L Jut~y 



Due to Proposition 14.61 the first summand converges to zero whenever 

ut-z 2 {t) = (u-l)t/2-r(t) ->• oo ast^oo. (4.24) 
Assume that r also satisfies 

lim h((u - l)t/2 - r(t))r(t) = 0. (4.25) 



t— >oo 



Then, for arbitrary e > 0, there exists to such that for all t > to 

fut—m\t 

< fx' 1 / h(x)dx < fx~ 1 h((u-l)t/2-r(t))r(t) < e. 

J Ut — Z2 (t) 
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Thus, when (14 .24p and (I4.25[) hold and e > is chosen such that b + e is a 
continuity point of the law of X* 

{/■(«— mi)t 
6 < X (ut-y) < b + / dx 
./ ut-z 2 (t) 

< sup P{X (ut-y) G + 

m 1 t<y<Z2(t) 

->■ P{X * e (6,6 + e]} 0, 

since 6 and 6 + e are continuity points of the law of X*. We thus have proved 
that lim^oo J l2 (t) = if r satisfies the conditions (g23D, fljjZID and (g^Eg) . A 
possible choice of r such that the above conditions are satisfied is the following. 
Let 5 = (u - l)/4. Then choose r as r(i) = h(5t)~ 1/2 A 5t, t > 0. Then (14^23]) 
holds since ->• as t ->• oo and (14.241) holds since r(t) < 5t. Finally, (I4.25P 
holds since h(t(u - l)/2 - r(t))r(t) < h(5t) l/2 -> as t -> oo. The proof of 
(H20D is complete. □ 

5 Proofs of the limit theorems with scaling 



In this section, we prove the results presented in Subsection 12.21 



5.1 Proof of Theorem 12.7 



Whenever possible we intend to treat all cases simultaneously. To this end, for 
t > 0, put 

X(ut)-ffh(y)dy 

X t {u) : = , u > 0. 

g{t)h[t) 

Reduction to continuous and decreasing response function 

Regarding the proof of Theorem 12.71 we make our life easier by showing that 
without loss of generality we can replace h by a decreasing and continuous 
function h* on R + satisfying h*(t) ~ h(t) as t — > oo. This follows an idea in 

We thus need to construct a function h* as above and prove that for this 
function 

L h* (ut - y) dN(y) - a' 1 C h*(y) dy 
X* t {u) := J[ ° M] ^ ' T^TTX- ^~ ^ Y ( u ) (5-1) 

ty ' g(t)h*(t) t^oo y ' y ' 

where Y(u) := W(u), u > if (3 = 0, and 

pU 

Y(u) := W(u)u-P + /3 (W^-Wiy^iu-yy^dy, u>0 

Jo 

if (3 > 0. Then, to ensure the convergence X t {u) F(w) as t — » oo, it suffices 
to check that, for any u > 0, 

J M (M^-v)-*V-v)) <*#(!/) p n + 

- L ^— ■ t-ttts -> as t — >• OO, (5.2) 
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and 



- h*(y)) dy 



as t — > oo. 



(5.3) 



g(t)h(t) 

We begin with the construction of ft*. By assumption, ft is eventually de- 
creasing. Hence, there exists an a > such that ft is decreasing on [a, oo). Let 
ft be a bounded, right-continuous and decreasing function such that h(t) = h{t) 
for t > a. Note that the so defined ft is non-negative. The first observation is 
that replacing ft by ft in the definition of X(t) will not change the asymptotics. 
Indeed, if X denotes the shot noise process with the shots occurring at times 
5*o, 5*i, . . . and response function ft instead of ft, then for any u > and large 
enough t, 



\X(ut) - X(ut)\ 



< 



d 
< 



N(ut) 

h{ut — Sk) — h(ut — Sk) 
sup \h(y) -h(y)\(N(ut) - N(ut- a)) 

ye[0,a] 

sup |%) -h(y)\N(a) 
ye[0,a] 



by the well-known distributional subadditivity of N. The local boundedness 
of h and h ensures the finiteness of the last supremum. Since /3 < 1/a, in all 
cases we have lim^oo g(t)h(t) = oo. Consequently, 



X(ut)-X(ut) P 
— - — / \ i / \ — 1 -> as t -> oo. 
0(t)/i(t) 



(5.4) 



Further, for ttt > a, 



tf(h(y)-h(y))dv 



g(t)h(t) 



< 



f ut \h(y)-h(y)\dy 
g{t)h(t) 

I[o,a] \ h (y)-Hy)\dy 



->■ as t — >• oo. (5.5) 



Thus, in what follows, we can replace h by ft.. We will now construct h* from 
ft. To this end, let 9 be a random variable with the standard exponential 
distribution. Set 



h*(t) := Eh((t-6) + ) = e-*(ft(0)+ / h(y)e y dy 



t > 0. 



(5.6) 



It is clear that h(t) < h*(t), t > and that ft* is continuous and decreasing 
on R + with ft*(0) = ft(0) < oo. Furthermore, h*{t) ~ h(t) ~ ft(t), t ^ oo. 
While this is trivial if lim^oo h{t) ^ 0, in the opposite case (lim^oo h(t) = 0) 
the first equivalence does require a proof. We use the second equality in (15. 6p . 
Being a regularly varying function 1/ft grows subexponentially fast. Using this 
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and the regular variation of h at infinity, we infer for any e G (0, 1): 



h*(t) 
hit) 



E 



h(t) 



!{6»>et} 



+ E 



h(t) 



{8<et} 



^ h(0) £t h((l-e)t)„ £t , M N g 
< ^—^e~ £t + — ^ — (l-e~ Et ) ->■ (l-s) p ->■ 1. 

t— >0O £— >0 



Since h(t) < h*(t) for all t > 0, this implies ~ /i(t) as £ — )■ oo. Let us 

now prove that 



lim / {h*(y)-h{y)) dy = h(0). 
We use the representation 

V(y)"%)) 

= £(0)(l-e-*)-E / A(y)dyl {e < t} 



(5.7) 



%) dye- 



Since /i grows subexponentially, the last term vanishes as t — > oo, and we are 
left with investigating the second term. By the monotonicity of h and the 
dominated convergence theorem, 
/ r-t 

E 



h(y) dy t {8 <t} ) < E(9h(t - 9) I {0 < t} ) ^ as t ->• oo, 
/ 

which proves 05. 7J - In particular, 

J Q ut (h(y) - h*(y)) dy f Q ut (h*(y) - %)) dy 



g(t)h(t) 



g(t)h(t) 



— > as t — > oo 



because lim^oo g(t)h(t) = oo. In combination with (15. 5p the latter proves 
(15. 3p . Recalling (|5.7p and the fact that in all cases lim^oo g(t)h(t) = oo, we 
conclude from Lemma IA.6I (with f\ = h* and f'2 = h) 

I [0 ,ut](h(ut-y)-h*(ut-y))dN(y) 



g(t)h(t) 



kuA h *( ut -y)- h ( ut -y)) dN (y) & 

— > as t — > 00. 



This together with ( 15. 4 p leads to (15. 2p . It remains to prove (15.11) . 



Proof of dSIH 

By the Cramer- Wold device and the discussion in Subsection 15.11 in order to 
show finite-dimensional convergence of X t (u), it suffices to prove that for any 
n G N, 71, . . . , 7„ G IR and < U\ < . . . < u n we have that 

n n 

y^j k Xl(u k ) ->> ^7 fc F(Mfc) as t -)■ 00. 
fe=i fe=i 
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Integrating by parts we obtain that 

n 

^lkX* t {u k ) 

n 

E 



k=l 



^g(t)h*{t) \ J (0>Ukt] \ n 



Ik 



^2g(t)h*(t) 



(N(y)-fi- 1 y)d(h*(u k t-y)) 



(Uk 



k=l 



h*(u k t) 
h*(t) 



Ik 



X g(t)h*(t) 



(h*(0) -h*(u k t))(N(u k t) 



[0,u k t) 



N(u k t-y)-^LJL)d(-i, („)) 



h*{u k t) 
h*(t) 



k=l 

| A Tfc ~ N ( u kt-y) - ^y) d(-h*(y)) (5g) 

fc=l 



0(t)/l*(*) 



where the definition of W t (u) should be recalled from (13. 6p . 

Case /3 = 0. Our aim is to show that each summand of the second term in 

(15. 8p converges to zero in probability, for the convergence 



J2^ k X*(u k ) A J2^ k Y(u k ) = J2 lk W( 



Uk 



k=l 



k=l 



k=l 



is then an immediate consequence of lim^oo h* (u k t) / h* (t) = 1, (13.61) and Slut- 
sky's theorem. 

For the kth summand in (15. 8p . we have 

f[o,u h t)( N M - N(u k t-y) - ii- l y) d{-h*{y)) 



< 



g(t)h*(t) 

f { o, Uk t)(N*(u k t) - N*(u k t-y) - ^y) d(-h*(y)) 



+ 



g(t)h*(t) 

J[o,u k t) ( N M - N*(u k t) - (N(u k t-y) - N*(u k t-y)))d(-h*(y)) 



g(t)h*(t) 



Both terms tend to in probability. For the second, this follows from (I3.2p and 
(13. 3 p with t replaced by u k t, Markov's inequality and the fact that g(t)h*(t) —t 
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oo as t — > oo. The latter fact together with Markov's inequality also shows 
that for the first term to converge to in probability it is sufficient to check 
that 

hm — - . . , . . = 0. 

i^oo g{t)h*(t) 

By Proposition 12.91 E \N*(y) — = 0(g(y)) as y — > oo. Consequently, it 

is enough to show that 

k ut] 9(y)d(-h*(y)) 
hm — - — . — . . = 0. 

t^oo g(t)h*(t) 
Since the function g(t)h*(t) is regularly varying, the latter is equivalent to 

t^oo g{t)h*(t) v ' 



Using 03.71) gives 

I M 9(y)d(-h*(y)) < A f M y^- s d(-h*(y)) 
g{t)h*(t) ~ tV a - s h*(t) 

for t > to, and, as t — > oo, the last ratio tends to zero by Theorem 1.6.4 in [5]. 
Further, since g{t)h*{t) — > 0, also 

r W(y)d(-ft*(y)) n 

hm — — - — r— — — = 0. 



t— >oo 



g(t)h*(t) 



Thus, follows. 

Case > 0. For any p e (0, 1), one can write 

X;(u k ) = W t (u k ) f ^^-+ [ (W t (u k )-W t (v))ui k (dv) 



h*(t) 



(0,u 



" \ L ) J(0,pu k ] J(pu k ,u k ] 

where v\ k is the finite measure on [0, u k ] defined by 

* / H h*(t(u k -b))-h*(t(u k -a)) ^ , , 

is t:k {a,b\ := — j , 0<a<b<u k . 

In view of (13. 6p and the continuous mapping theorem, 

W t (u k )-W t (v) =► W{u k )-W(v) ast^oo. 

Further, by the regular variation of h*, the finite measures z/ f * k converge weakly 
on [0,pu k ] to a finite measure v k on [0, pu k \ which is defined by v k {a,b\ = 
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(life — b) /3 — (nfc — a) 13 . Clearly, the limiting measure is absolutely continuous 
with density x (3{u k — x)~^~ x , x e [0,pu fc ]. Hence, by Lemma lA. 2 1 



(H/ t K)-m(^))^ fc (d^) 



A W{u k )u~ p + (3 I {W{u k ) - W{v)){u k - v)- - 1 dv . 



Likewise, again by the continuous mapping theorem 
h(u k t) 



t(u k 



fc=i 



h(t) 



It n 



(W t (u k )-W t (v))u: k (dv) 



(0, pu k ] 



fc=i fc=i - 70 



,-/3-l 



du 



According to Theorem 3.2 in [3], it remains to check that, as p t 1, 



fc=i 



k=l 



J2^W(u k )u- p + ^ 7 ^ / W^-W/^K-^-^d? 



cl 



fc=i 



fc=i 



and that, for any c > 0, 



lim lim sup P 



The first relation is equivalent to 



> c 



0. (5.10) 



^7fc/3 / - - v)~P- 1 dv ^0 as ptl- (5.11) 

To prove (15.111) it suffices to verify that each summand converges to zero in 
probability. But each summand actually tends to zero a.s. by the discussion 
in Subsection 12.31 

The sum in (I5.10p equals 



A I[o (i-pK^M) - N{u h t - y) - ^ l y)d{-h*{y)) 

2_^ik— 

k=l 



g(t)h*(t) 



In view of (13. 2p . f 13 . 3 1) . Proposition 12.91 and Markov's inequality it suffices to 



check that, for k = 1, . . . ,n, 



r v k{i- P )u k t]9{y)&{-h*{y)) 

hm hm sup - ±2 ± — x , . . = 

pti t^oo g(t)h*(t) 
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or just 

/ [0 , (1 - P) ^(y)d(-^(y)) _ 

STS P g(t)h*(t) - U ' (5 ' 12) 

for g(t)h*(t) is regularly varying. Since g(t)h*(t) — > oo as t — > oo by the 
assumptions of the theorem, we have 

hm — — - — . ,, . . = 

i^oo g(t)h*(t) 

and, further, 



g(t)h*(t) ~ ' t x l°-~ h h*{t) 

:(1"P) 



l/a-p-6 

where the last relation is justified by Theorem 1.6.4 in [5J, f !5. 12[) follows. To 
complete the argument, we need to prove Proposition 12.91 



5.2 Moment convergence when fi < oo 

In this subsection we prove Proposition 12.91 Keeping in mind the weak con- 
vergence relation (13. 6p with u — 1, uniform integrability of the family \N(t) — 
t/fj,\/c(t), t > 1 would suffice to conclude convergence of the first absolute 
moments. However, it seems such an argument only works in the case (Al), 
see [T2l Theorem 3.8.4(i)]. This is why we follow a different approach. In 
particular, we offer a new proof for the case (Al), for it requires no extra work 
in the given framework. 

Proof of Proposition \2.9i . Our purpose is to show that 

EliVM-p-tl = 
g(t) 

where g is defined as in the context of ( 13. 6p . We start with the representation 

E |<SjV(/in) ~ S n \ = E(5'jv(^n)Vn — SjV(/m)An) 

= fiE ((N(nn) Vn) - (N(fin) An)) = //E \N(/j,n) - n\, 

where the second equality follows from Wald's identity. We thus infer 

E (\S n - /in\ - {S N (jm) ~ IJ>n)) < iiE\N(/in) - n\ 

< E (\S n - fj,n\ + (Sjffrn) - /in)). (5. 14) 

From the discussion in Subsection 13.21 we know that c(n) _1 (S' ri — n/i) A —W. 
Furthermore, according to Lemma 5.2.2 in 

S n - [in 



neN 



supE -— — - < oo 



c(n) 



1+.5 
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for some 5 > 0. Consequently, 

E I S n — an I , 
lim = E W1. (5.15) 

If F is non-lattice, then from [31] it is known that 

{const in the case (Al), 

const • £(t) in the case (A2), (5.16) 
const ■ t 2 - a £(t) in the case (A3), 

as t — > oo. Similar asymptotics hold in the lattice case. In fact, when F is 
lattice with span d > 0, then, in the case (Al), 

lim E(Stv(W) — nd) — >■ const 

n-+oo 

by Theorem 9 in [7]. Hence 

E(5iv W - t) = 0(1) as t ->■ oo. 

In the cases (A2) and (A3), according to Theorem 6 in [38J, E(Sjv(t)— £) exhibits 
the same asymptotics as in the non-lattice case. 

Recalling that c(t) is regularly varying at oo with index 1/a (where a = 2 
in the Cases (Al) and (A2)), we conclude that 

lim E (^;> -H = o. 

rwoo c(n) 

Applying this and (15.151) to (I5.14p we infer 

E\N(an)-n\ ^, TTrl 
lim n 1 \ ! = E\W\. 

n^oo C[n) 

Now we have to check that this relation implies (I5.13p . For any t > there 
exists n = n{t) 6 N such that t G (fin, fi(n + 1)]. Hence, by subadditivity, 

E(N(t)-N(jm)) < E(N(ji(n+l))-N(jm)) < EN(/i). 

It remains to observe that, as a consequence of the regular variation of c(t), 

we have lim^oo c(fm(t) fx' 1 ) / c(t) = /i" 1 ^, hence f)5.13p . 

The formula for E | W \ in the case (A3) is proved in Lemma IA.1I 

It remains to check that E \N*(t) — /i -1 t| exhibits the same asymptotics as 

E \N(t) — ii~ x t\. But this is a consequence of the chain of equalities 

E\N*[t)-N{t)\ = E(N(t)-N*(t)) = ^(E^-i) = o(c(t)) as t oo 

where the second equality follows from Wald's equation and the third is a 
consequence of (15.161) . The proof is complete. □ 
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5.3 Proof of Theorem I23U1 

For t > 0, put 

v , , X(ut) / [0 ,«t] - diV (^) 
1 ' 9(t)h(t) g(t)h(t) 

For any n G N, fix 71, . . . , j n G K. and < Ui < . . . < « n . We have to show 
that 

n n 

u h) -> ^7fe^( M fe) as t 00, 
fc=i fc=i 

where F(w) := JJ 0u] (« - y)~ p dW(y), u>0. 

Since the convergence lim^^ h(ut) / h(t) = is uniform on compact 
subsets of (0, 00) [5, Theorem 1.2.1], and (W(u)) u >o has continuous paths a.s., 
the relation (13.81) and Lemma [A. 21 entail 

f h(t(u k -y)) N(ty) d f , ^ . v 

/ TJ7\ d ^7T ~+ (uk-y) P dW{y) as t -> 00 

for any p G (0, 1) where here and hereafter integration w.r.t. d N ^ means inte- 
gration w.r.t. Vt(dy) where the measure v t is defined by Ut(A) = g(t)~ 1 N(tA), 
A C M + Borel. By the continuous mapping theorem, 

A f h(t(u k -y)) N(ty) d A f . ^-B Aur t \ 

^ J[0, P u k ] h \t) 9(t) ^ J[0,pu k ] 

as t 00. According to Theorem 3.2 in [3J, it remains to check that, as p t 1, 



n „ n „ 



and that, for any c > 0, 



lim lim sup P 



V- / h(t{u k -y)) N(ty) 



fe=i 



;u fc -y)-^dW(y) 



> c\ = 0. (5.17) 



The first relation is equivalent to 

n „ 

^7* / (u»-y)-"d^(j/) 4 as pfl- (5-18) 

fc=1 J[pu k ,u k ] 

To prove (15.181) it suffices to verify that each summand converges to zero in 
probability. Hence (I5.18P is a direct consequence of Lemma 12.131 
For (I5.17p . in view of Markov's inequality it suffices to check that 

, , Lu k tu k t] h (ukt-y)dEN(y) 

lim lim sup lpUkt ' Uktl = 0. 

pti <->oo h(t)g(t) 

Recalling that h(t)g(t) is regularly varying the latter holds true by Lemma I5T21 
below. This completes the proof of finite-dimensional convergence. 

Convergence of moments follows from Lemma 15.31 below. The proof is 
complete. 
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5.4 Moment convergence when /i = oo 

Lemma 5.1. Assume that \i — oo and Zei /i : M + — > R + &e a measurable and 
locally bounded function such that 

hit) 

hm ^ ' , = ce 0,oo . 

TTien 

lim EX(t) = c. 

t—^oo 

F 

In particular, X[t) — > as t — oo if c = 0. 

Proof. Denote by Z{t) := t — SatM-i the undershoot at time t and put 
The proof is based on the representation 



EI(i) = / /i(t - x) U(dx) = Ef(Z(t)), t>0. 
J[o,t] 

Under the sole assumption /i = oo, the renewal theorem gives Z(t) — > oo in 
probability. Hence f(Z(t)) — > c in probability. If c < oo, the function / is 
bounded, and lim^^ E f(Z(t)) = c by the dominated convergence theorem. 
If c = oo, we obtain lim^oo E f(Z(t)) = c = oo by Fatou's lemma. 

The last assertion of the lemma follows from Markov's inequality. □ 

Now we are ready to prove Proposition 12.121 

Proof of Proposition \2.12l Since the exponential law is uniquely determined 
by its moments, the second assertion of the proposition is an immediate con- 
sequence of the first. 

To prove convergence of moments, we use induction on k, the order of the 
moments. The case k = is trivial, the case k = 1 follows from Lemma 15.11 
Assuming that 

lim E X j {t) = c^jl for j = 0, . . . , k - 1, 

t— >oo 

we will prove that 

lim EX k {t) = c k k\. (5.19) 

t—¥00 

To this end, we use the representation 

X(t) = h(t)+X,(t (5.20) 

where 

X*{t) := + Si) l {Sj _ Sl < t} = X(t). 

3>l 
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The latter implies 

fc-i 



x(t) k = x4^6f%< t) + E(^( t ) H ^(i-(i) J %< 1 } 



3=0 

We have EX(t) k = Ef k (Z(t)) where 



<*} 



Arguing as in Lemma I5.1[ it suffices to show that 

\imf k (t)=c k k\, 



t— >oo 



as fk(t) is then bounded and relation ( 15.1 9p follows by the dominated conver- 
gence theorem. 

Since lim^oo h(t) = by the assumption of the proposition, and the ex- 
pectations EX*(t — £i) J 1 l{£x<i}, j = 0, . . . , k — 1 are bounded by the induction 
hypothesis, we conclude 



Hence 

lim fk(t) = k lim 



m > t} 

hWEX^t-ti)"- 1 !^) 



0. 



/-x ' / - x P{£ > / } 

-i (-\ (t) — //(/")) " _J 

t— >oo 

fc-2 



cA; limE(X(t) - h(t)\ 

t— >oo 

ck lim ^EX{t) k - 1 + J2 ^ ^Htf-^EXity 



ck\imEX(t) k - 1 = c k k\ 



t—>-oo 



where the penultimate equality follows from the induction hypothesis and 
lim^oo h{t) = 0. □ 

Lemma 5.2. Assume that the assumptions of Theorem \2.10\ hold. Then 

lim lim sup I h(t-y)U(dy) = 0. (5.21) 

pfi t^oo h[t) J [pt)t] 

In particular, 



lim F ^^ EX(t) = E [ (l-y)- p dW(y) 
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Proof. We use the notation of Lemma \5. 11 that is, Z(t) := t — SV(t)-i denotes 
the undershoot at time t and f(t) := h(t)/F{£ > t}, t > 0. Then, the 
expression under the double limit in ( I5.2ip equals E f(Z(t)) l{z(t)<(i-p)t} //(£)■ 

Case 1: We first consider the case when a > (3 or a = (3 and c = oo. 
If a > (3 then, by Theorem 1.5.3 in [5] there exists an increasing function u 
such that u{t) ~ f(t) as t — > oo. If a = (3 and c = oo such a function u exists 
by assumption. Now fix e > and let t > be such that (1 — e)u{t) < f(t) < 
(1 + e)u{t) for all t > t . Then 

Ef(Z(t))l {z{t) < to} sup < v < gf0 f(y) 

m - a 

by the local boundedness of /. Further, for t such that (1 — p)t > to, 

Ef(Z(t)) Mt <z{t)<(i~ P )t} < l + eEu(Z(t)) l {Z (t)<(i-p)t} 
f(t) ~ l-e u(t) 

< \^J{Z(t)<(l-p)t}. 

By a well-known result due to Dynkin (see, for instance, Theorem 8.6.3 in [5]) 

-1— p 

?{z(t) < a- P )t} = - — r / 

t— >oo 



\im¥{Z(t)<(l-p)t} = — —1 / ' y-(l - y)"- 1 dy 



When p f 1 the last integral goes to zero, which proves (15.211) . 

Case 2: Now consider the case when a = (3 and c < oo. Then / is 
bounded. Hence Ef(Z(t)) l{ Z (t)<(i- P )t} < const • ¥{Z(t) < (1 - p)t}, t > 0. 
The rest of the proof is the same as in the previous case. 

Turning to the second assertion of the lemma, we observe that 

%4 / h{t-y)U(dy) = P{£>« / ^A(d-,) 

where Z7 t ([0,ar]) = U(tx)/U(t), < x < 1. Formula (8.6.4) on p. 361 in 
says that lim^oo P{£ > t}U(t) = T(l — «) _1 r(l + «) _1 . Hence, the measures 
U t (dx) converge weakly to ai a_1 dx as t — > oo. This in combination with the 
uniform convergence theorem [5l Theorem 1.2.1] yields 

limP{£ >*}£/(*) / m }~ V)) U t (dy) 
J\o, P ] h>[t) 

' //) V ; <l// 



o 



'[0,P] 



r(l-a)r(l+a) 

r(i-/3) 



p^i r(l + a-/3)r(l-a)' 
An appeal to (I5.2ip proves the second assertion of the lemma. □ 
Lemma 5.3. Under the assumptions of Theorem \2.1(X (I2.15P holds. 
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Proof. Case 1: either a > (3 or a = (3 and c = oo. 

Set g(t) = 1/P{£ > t} and observe that lim^oo g(t)h(t) = oo in the present 
situation. We prove the result only for u — 1. Define 

. _ g A r (l-/3 + (j-l)(«-/^)) . N 
We then have to show that 

lim . .,;/■. = d, 5.22 

for all j G N. We will use induction on j. The case j = 1 follows from Lemma 
15.21 Assuming that (15.221) holds for j = 1, . . . , k — 1, we will prove (I5.22p for 
j = k. 

From the decomposition (I5.20p . one can derive the following representation 
for EX(t) k : 

EI(t) fc = / r k (t-y)U(dy) (5.23) 
J[o,t) 

where 

fc— 1 s , \ ft — 1 

3=0 j=0 

for some real constants Vj, < j < k — 1 with -u^i = k. 
If we can prove that 

fc^W = **-" (5 ' 24) 

which, among other things, means that r&(£) is regularly varying at oo with 
index (k — l)at — k/3, then fl 5 . 2 3 1) in combination with the argument given in 
the proof of Lemma 15.21 shows that 

EX(t) k U(t) I M r k (t-y)U(dy) 

urn — — KCLui nm — — . WT . . 

t-*» g(t) k h(t) k t^oo g{t) r k {t)U{t) 

akdk 



i [\l-y)^^y^dy 
1 + «) Jo 



r(i-a)r( 

r(l-/3 + (fc-l)(a-/3)) 
r(l - a)r(Jfe(a - 0) + 1) 



kdje-i = d k . 



We now verify (15.241) . By the induction hypothesis, for j = 0, . . . , fc— 1, EX(t)- 7 
is regularly varying with index j(a—j3). Hence, for such j's, h(t) k ~i EX(t) J are 
regularly varying with indices ja — k/3. Since x /i(t) is regularly varying 

with index (k — l)a — k/3, we conclude that 

hm — - = 0. 

t^oo g k -\t)h k {t) 
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Hence 

EX(t) k , kEXitf- 1 

lim ... , , , , , = lim ... , , , . , : = kdk-i, 

t^oo g(t) k ~ l h(t) k t^oo g(t) k - 1 h(t) k - 1 

which proves (15.241) . 

Case 2: a = (3 and c < oo. f|2.15p has been proved in Proposition 12.121 

under weaker assumptions. □ 



A Appendix: Auxiliary results 

Lemma A.l. Let W be a random variable with characteristic function given 
by (I2.14p . Then, for r < a, 

2T(r 4- 1) 

E\W\ r = 1 ; sin(r7r/2)r(l -r/a)|r(l-a)r /a cos(7rr/2-7rr/a) 
nr 

where T(-) denotes the gamma function. In particular, 

E\W\ = 2 7 r- 1 r(l - l/a)|r(l -a)| 1/a sin(7r/a). 

Proof. We use the integral representation for the rth absolute moment (see 
Lemma 2 in [2]) 

mlrrrlr Hr + l) /rvr\ f 1 — Re E e itw , /A , 

mr := E \W\ = -± -sin — / — I dt . (A.l) 

Set A := 7r -1 r(r + 1) sin (r7r/2), 5 := T(l - a) cos (vra/2) and C : = T(l - 
a) sin (ttcu/2). Using Euler's identity e lx = cosx + isinx in (I2.14p . we obtain 

ReEe iW = exp (-B\t\ a ) cos (-C\t\ a sgn(t)). 

Substituting this into formula (lA.lj) yields 

f°° 1 - exp (-Bt a ) cos (Ct a ) , 
m r = 2A ^ — i i L dt . 

Jo t r+1 
A change of variables (u := t a ) gives 
2A 



m r = — 

a 

2A 

a 



POO 

/ (1 - exp (-Bu) cos (Cu))u~ l - r/a du 
Jo 

poo 

/ (l-exp(~Bu))u- l - r/a du 
Jo 
2A f°° 

+ — / (exp(-Bu) - exp (-Bu) cos (Cu^u- 1 -^ dt 
a Jo 



lu 

=: /i+J 2 . (A.2) 
According to formula (3.945(2)) in [Hi], we have 
2A 



a 



Y(-r/a)[B r/a - |T(1 - a)\ r/a cos (vrr/2 - vrr/a)). 
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To calculate I\ we use integration by parts: 

h = — / (1 -exp(-Bu))u- 1 - r/a di 
« io 



2AB 



r 



/ u- r/Q exp(-5M)dn 



= r i-r/a = T(-r a). 

r a 

Now plugging in the values of I\ and J 2 in (|A.2[) gives 

2A 

m r = r(-r/a)|r(l - a)| r/a cos (7rr/2 - vrr/a) 

a 

9/1 

= — r(l -r/a)|r(l-a)r /a cos(7rr/2-7rr/a). 
r 

The proof is complete. □ 

Lemma A. 2. Let < a < b < oo. Assume that X t (-) =>- X(-) as t — >■ oo in 
D[a,b] in the Mi topology. Further, assume that v t , t > are finite measures 
such that u t — Y u weakly as t — > oo where v is a finite measure on [a, b], which 
is continuous w.r.t. Lebesgue measure. Then 

/ X t {y)v t (dy) A / X{y)v{dy) ast-^oo, 

J[a,b] J[a,b] 

and if X is a.s. continuous at some c G [a, b], then 

X t (c)+ [ X t {y)v t {dy) A X(c) + [ X{y)v{dy) as t 

J[a,b] J[a,b] 

Proof. The assertion of the lemma follows from Lemma 6.5 in [16] in combi- 
nation with Skorokhod's representation theorem. □ 

Lemma A.3. Let (Xi,A\) and (X 2 ,*4.2) be measurable spaces. Let /ii(-) be a 
finite measure on (Xi,Ai). Assume that /^(^j •) is a measure on (X2,A2) for 
every x G X\, and that for every B G Ai the function X\3 x fi2{x, B) is 
measurable with respect to A\. Then u(B) := J x /i 2 (x, B)d[ii 



— > oo. 



x) is a measure 



on (X 2 ,A2). Furthermore, for every non-negative measurable function f on 
(X 2 ,A2), the function g(x) := f x f (y) fi 2 (x , dy) is measurable with respect to 
Ai and 



fdu = / gd^. (A.3) 

The proof of this lemma is a standard approximation argument: check 
(IA.3j) for indicators of sets in A2, then for the finite linear combinations of 
such indicators with positive coefficients and finally for arbitrary non-negative 
measurable functions. 

Lemma A. 4. Let (X(u,u)) u& ^ be an arbitrary increasing random process de- 
fined on probability space (Tl, A, P). For fixed k G N let h : M. k — > IR + be a 
positive Borel function. Then 



E 



h( Sl ,...,s k )dX( Sl )...dX(s k )= [ h{s 1 ,...,s k )E(dX{s 1 )...dX(s k )). 

k JR k 
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Proof. Lemma IA.3I can be applied as follows. Define (X\,Ai) := (Q,A) and 
(X 2 ,.4. 2 ) '■= (M. k ,B) where E is a standard Borel a-algebra of subsets of M. k . 
Set also fii := P. For every u G Q put 

/j, 2 (uj, (ai, 61] x ... x (a fc , & fe ]) := b x ) —X(u, a x )) . . . 6 fc ) - a fe )) 

and extend this to a measure on (X 2 ,^4 2 )- This is possible since X(u,u) is 
increasing for almost all u. It is clear that 00 > ^{oj^A) is measurable for 
every A e B. By Lemma |A.3[ v(A) = E/i 2 (o;,74) is a measure and for any 
given positive Borel function h : M. k — > W+, the function g : — » M + defined 
by := J Rfe /i(si, . . . , Sfc)/i 2 (co', dsi, . . . , ds/c) is measurable and 



E / 7i(si,...,s fe )cLY(si)...(LY(s fe ) 

E / h(s h ...,s k ) /i 2 (w, dsi x . . . x ds k ) 

JM. k 

g(u)W(du) ^ / h(s u . . . , s k ) u(ds x x . . . x ds k ) 



[ h( Sl ,...,s k )E(dX( Sl )...dX(s k )). 



□ 



Lemma A. 5. Let f : M + — > M + be a decreasing function with lim^oo f(t) > 0. 
Then, for every 9 > 0, 

/ f(6y)dy = Y^f{9k)+5 n {9), neN, 
Jo k=0 

where S n (8) converges as n — )■ 00 to some 5(9) < 0. 
Proof. We assume w.l.o.g. that 9 = 1. For each n > 1, 

n r-n ri-1 / \ 

Y,f(k)- f(y)dy = T (/(*)-/ f(y)dy)+f(n). 
k=o Jo k=o V Jk ' 

Since / is decreasing, each summand in the sum is non-negative. Hence, the 
sum is increasing in n. On the other hand, it can be bounded from above by 

n-1 , „ k+ i s n-1 

£(/(*)- / f(y)&y) < £(/(*)-/(* + 1)) < /(o) < 00. 

Consequently, the series ^2 k>0 (f(k) — J k +1 f(y) dy ) converges. Recalling that 
lim^oo f{n) exists completes the proof. □ 

Lemma A. 6. Let f\, / 2 : K+ — > fre bounded decreasing functions such that 
fi{t) > fzit) for all t E R+ and such that / *°(/i(y) — f2(y)) dy > for some 
t > 0. T/ien 

sup — — — < 00. (A.4) 

*>to J 



53 



Proof. Decompose the integral in the numerator of the left-hand side of flA.4j) 
as follows: 



(fi(t-y)-f 2 (t-y))dN(y)+ / (fi(t-y)-f 2 (t-y))dN(y) =: h(t)+I 2 (t). 
[o,L*J] ■'(W.*] 

By the distributional subadditivity of N, we get for hit): 

hit) < [ f 1 (t-y)dN(y) < fi(0)(N(t) - N([t\)) 

< A(o)(JV(t)-JV(t-i)) < / x (o)JV(i), 

hence EJ 2 (t) < /i(0)EJV(l) < oo for all t > 0. It remains to consider 

L*J-i , 

Eh(t) = fi(t)-f 2 {t)+E^2 / (fi(t-y)-f2(t-y))dN(y) 

Ltj-i 

< /i(0)+ ^(/i(t-j-l)-/ 2 (i-i))E(JV(j + l)-JV(,l) 

i=o 
Ltj-i 

< A(0)+ ^(A(t-i-l)-/ 2 (t-j))EiV(l) 

i=o 

= EiV(l)f / (/i(y)-/ a (y))dy+0(l)Y 



This proves the lemma. □ 
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